Oct 30 20:38:10.586616 ip-10-0-142-183 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 20:38:11.006792 ip-10-0-142-183 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:11.006792 ip-10-0-142-183 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 20:38:11.006792 ip-10-0-142-183 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:11.006792 ip-10-0-142-183 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:11.010888 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010828    2566 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:11.010888 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010889    2566 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010893    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010896    2566 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010899    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010902    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010905    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010908    2566 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010911    2566 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010914    2566 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010916    2566 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010919    2566 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010921    2566 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010930    2566 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010932    2566 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010935    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010938    2566 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010940    2566 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010944    2566 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010949    2566 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:11.010952 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010953    2566 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010955    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010958    2566 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010961    2566 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010965    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010967    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010970    2566 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010972    2566 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010975    2566 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010977    2566 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010980    2566 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010982    2566 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010984    2566 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010987    2566 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010990    2566 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010992    2566 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010994    2566 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.010998    2566 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011002    2566 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011005    2566 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:11.011437 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011008    2566 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011011    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011013    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011016    2566 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011018    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011021    2566 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011023    2566 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011025    2566 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011028    2566 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011030    2566 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011032    2566 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011035    2566 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011037    2566 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011040    2566 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011043    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011046    2566 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011048    2566 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011051    2566 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011053    2566 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011056    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:11.012137 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011059    2566 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011061    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011064    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011066    2566 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011069    2566 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011071    2566 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011074    2566 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011077    2566 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011079    2566 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011082    2566 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011084    2566 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011086    2566 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011090    2566 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011092    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011095    2566 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011097    2566 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011099    2566 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011102    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011104    2566 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:11.012671 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011107    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011109    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011112    2566 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011114    2566 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011117    2566 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011119    2566 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011121    2566 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011125    2566 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011127    2566 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011130    2566 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011132    2566 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011135    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011138    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011141    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011144    2566 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011147    2566 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011150    2566 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011152    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011154    2566 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:11.013193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011157    2566 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:11.013995 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011160    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:11.013995 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011162    2566 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:11.013995 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011164    2566 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:11.013995 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011167    2566 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:11.013995 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011169    2566 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:11.013995 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011171    2566 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:11.013995 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.011174    2566 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:11.014417 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014400    2566 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:11.014417 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014417    2566 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014424    2566 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014429    2566 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014433    2566 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014437    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014441    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014446    2566 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014449    2566 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014453    2566 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014458    2566 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014462    2566 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014466    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014470    2566 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014474    2566 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014478    2566 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014482    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014486    2566 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014490    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014494    2566 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:11.014534 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014498    2566 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014502    2566 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014507    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014511    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014515    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014519    2566 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014523    2566 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014527    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014531    2566 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014535    2566 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014540    2566 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014544    2566 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014548    2566 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014552    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014557    2566 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014561    2566 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014565    2566 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014569    2566 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014573    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:11.015386 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014577    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014581    2566 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014585    2566 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014589    2566 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014593    2566 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014596    2566 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014600    2566 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014604    2566 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014608    2566 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014612    2566 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014616    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014620    2566 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014624    2566 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014628    2566 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014635    2566 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014644    2566 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014652    2566 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014658    2566 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014663    2566 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014668    2566 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:11.016179 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014672    2566 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014676    2566 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014680    2566 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014685    2566 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014689    2566 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014693    2566 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014697    2566 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014701    2566 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014705    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014709    2566 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014713    2566 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014717    2566 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014721    2566 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014726    2566 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014730    2566 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014734    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014738    2566 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014742    2566 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014746    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014750    2566 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:11.016750 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014754    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014758    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014762    2566 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014766    2566 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014771    2566 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014777    2566 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014782    2566 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014786    2566 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014790    2566 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014794    2566 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014798    2566 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014802    2566 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014806    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014810    2566 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014814    2566 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014818    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014822    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014826    2566 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014831    2566 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014835    2566 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:11.017224 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014839    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014843    2566 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014847    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014851    2566 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014855    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014859    2566 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.014863    2566 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015672    2566 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015681    2566 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015686    2566 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015690    2566 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015695    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015699    2566 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015704    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015708    2566 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015712    2566 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015718    2566 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015722    2566 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015726    2566 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015730    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:11.017865 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015734    2566 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015738    2566 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015743    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015749    2566 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015755    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015761    2566 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015765    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015769    2566 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015773    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015778    2566 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015782    2566 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015787    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015791    2566 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015795    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015799    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015803    2566 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015807    2566 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015811    2566 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015815    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:11.018687 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015819    2566 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015823    2566 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015828    2566 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015832    2566 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015836    2566 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015840    2566 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015844    2566 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015848    2566 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015852    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015856    2566 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015861    2566 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015866    2566 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015870    2566 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015874    2566 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015879    2566 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015883    2566 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015886    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015890    2566 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015895    2566 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015899    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:11.019488 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015903    2566 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015907    2566 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015913    2566 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015918    2566 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015922    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015926    2566 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015930    2566 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015934    2566 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015938    2566 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015943    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015947    2566 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015951    2566 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015955    2566 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015959    2566 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015963    2566 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015967    2566 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015972    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015976    2566 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015981    2566 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:11.020113 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015985    2566 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015989    2566 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015994    2566 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.015998    2566 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016003    2566 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016010    2566 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016016    2566 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016021    2566 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016025    2566 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016030    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016034    2566 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016038    2566 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016042    2566 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016046    2566 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016050    2566 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016056    2566 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016060    2566 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016064    2566 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016068    2566 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016072    2566 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:11.020814 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016076    2566 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016080    2566 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016084    2566 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016088    2566 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016092    2566 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016096    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016100    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016104    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016108    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016112    2566 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016116    2566 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016120    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016124    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016129    2566 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.016133    2566 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017579    2566 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017596    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017607    2566 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017615    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017622    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017627    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 20:38:11.021290 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017634    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017641    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017646    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017651    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017657    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017663    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017669    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017674    2566 flags.go:64] FLAG: --cgroup-root=""
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017679    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017683    2566 flags.go:64] FLAG: --client-ca-file=""
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017699    2566 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017704    2566 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017710    2566 flags.go:64] FLAG: --cluster-domain=""
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017715    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017720    2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017725    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017730    2566 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017737    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017741    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017746    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017752    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017764    2566 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017769    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017774    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 20:38:11.021874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017779    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017783    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017795    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017801    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017806    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017812    2566 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017817    2566 flags.go:64] FLAG: --enable-server="true"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017822    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017828    2566 flags.go:64] FLAG: --event-burst="100"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017833    2566 flags.go:64] FLAG: --event-qps="50"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017838    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017843    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017847    2566 flags.go:64] FLAG: --eviction-hard=""
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017854    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017859    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017863    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017868    2566 flags.go:64] FLAG: --eviction-soft=""
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017873    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017877    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017882    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017886    2566 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017891    2566 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017895    2566 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017900    2566 flags.go:64] FLAG: --feature-gates=""
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017906    2566 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 20:38:11.022490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017911    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017916    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017922    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017926    2566 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017931    2566 flags.go:64] FLAG: --help="false"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017936    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017942    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017947    2566 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017952    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017958    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017963    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017968    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017972    2566 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017978    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017983    2566 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017988    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017993    2566 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.017997    2566 flags.go:64] FLAG: --kube-reserved=""
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018002    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018006    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018011    2566 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018015    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018020    2566 flags.go:64] FLAG: --lock-file=""
Oct 30 20:38:11.023063 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018024    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018029    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018035    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018044    2566 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018072    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018078    2566 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018083    2566 flags.go:64] FLAG: --logging-format="text"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018088    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018094    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018099    2566 flags.go:64] FLAG: --manifest-url=""
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018104    2566 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018111    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018116    2566 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018122    2566 flags.go:64] FLAG: --max-pods="110"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018126    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018131    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018136    2566 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018140    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018145    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018150    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018155    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018166    2566 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018171    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018176    2566 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018181    2566 flags.go:64] FLAG: --pod-cidr=""
Oct 30 20:38:11.023616 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018186    2566 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018190    2566 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018195    2566 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018199    2566 flags.go:64] FLAG: --port="10250"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018204    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018209    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0de095b62538ecf45"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018214    2566 flags.go:64] FLAG: --qos-reserved=""
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018219    2566 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018224    2566 flags.go:64] FLAG: --register-node="true"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018228    2566 flags.go:64] FLAG: --register-with-taints=""
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018234    2566 flags.go:64] FLAG: --registry-burst="10"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018238    2566 flags.go:64] FLAG: --registry-qps="5"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018242    2566 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018247    2566 flags.go:64] FLAG: --reserved-memory=""
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018253    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018258    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018263    2566 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018267    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018272    2566 flags.go:64] FLAG: --runonce="false"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018276    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018281    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018286    2566 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018293    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018297    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018302    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018307    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 20:38:11.024208 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018312    2566 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018317    2566 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018321    2566 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018326    2566 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018331    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018336    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018341    2566 flags.go:64] FLAG: --system-cgroups=""
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018346    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018354    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018373    2566 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018378    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018385    2566 flags.go:64] FLAG: --tls-min-version=""
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018390    2566 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018394    2566 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018399    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018403    2566 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018408    2566 flags.go:64] FLAG: --v="2"
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018420    2566 flags.go:64] FLAG: --version="false"
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018426    2566 flags.go:64] FLAG: --vmodule=""
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018432    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.018438    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018672    2566 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018679    2566 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018683    2566 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:11.024901 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018688    2566 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018692    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018696    2566 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018700    2566 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018707    2566 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018711    2566 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018715    2566 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018719    2566 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018724    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018728    2566 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018732    2566 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018739    2566 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018744    2566 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018749    2566 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018754    2566 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018758    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018763    2566 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018767    2566 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018771    2566 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:11.025555 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018775    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018781    2566 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018785    2566 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018790    2566 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018794    2566 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018798    2566 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018802    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018806    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018810    2566 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018815    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018819    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018823    2566 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018827    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018831    2566 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018835    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018839    2566 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018844    2566 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018850    2566 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018854    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:11.026040 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018858    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018862    2566 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018866    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018870    2566 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018877    2566 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018882    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018887    2566 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018891    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018895    2566 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018900    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018904    2566 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018908    2566 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018912    2566 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018916    2566 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018922    2566 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018926    2566 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018930    2566 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018934    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018938    2566 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:11.026504 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018943    2566 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018947    2566 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018951    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018955    2566 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018960    2566 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018964    2566 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018968    2566 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018972    2566 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018976    2566 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018980    2566 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018984    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018990    2566 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018994    2566 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.018998    2566 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019002    2566 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019007    2566 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019011    2566 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019015    2566 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019019    2566 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019023    2566 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:11.026936 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019027    2566 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019031    2566 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019035    2566 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019041    2566 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019045    2566 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019049    2566 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019053    2566 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019059    2566 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019063    2566 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019067    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019071    2566 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019075    2566 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019079    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019083    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019087    2566 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019091    2566 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019095    2566 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019100    2566 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019104    2566 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019108    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:11.027403 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019111    2566 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:11.027867 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019115    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:11.027867 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019120    2566 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:11.027867 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019127    2566 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:11.027867 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019131    2566 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:11.027867 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019135    2566 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:11.027867 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.019173    2566 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:11.027867 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019229    2566 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:11.027867 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019237    2566 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:11.027867 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019242    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:11.027867 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019247    2566 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:11.027867 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019251    2566 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:11.027867 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019255    2566 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:11.027867 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019259    2566 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:11.027867 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019263    2566 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:11.027867 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019267    2566 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:11.027867 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019272    2566 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019276    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019280    2566 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019284    2566 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019291    2566 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019295    2566 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019299    2566 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019303    2566 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019307    2566 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019311    2566 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019316    2566 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019320    2566 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019324    2566 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019328    2566 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019332    2566 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019336    2566 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019340    2566 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019344    2566 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019348    2566 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019354    2566 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019373    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:11.028241 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019377    2566 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019382    2566 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019386    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019390    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019394    2566 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019398    2566 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019402    2566 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019406    2566 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019410    2566 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019414    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019418    2566 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019423    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019428    2566 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019432    2566 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019436    2566 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019442    2566 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019446    2566 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019450    2566 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019454    2566 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:11.028768 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019458    2566 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019463    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019467    2566 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019471    2566 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019475    2566 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019480    2566 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019484    2566 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019488    2566 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019492    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019496    2566 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019500    2566 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019508    2566 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019514    2566 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019518    2566 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019523    2566 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019527    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019531    2566 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019535    2566 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019539    2566 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:11.029206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019543    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019548    2566 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019552    2566 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019556    2566 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019560    2566 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019565    2566 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019569    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019574    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019578    2566 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019585    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019589    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019593    2566 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019597    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019601    2566 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019605    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019610    2566 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019614    2566 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019618    2566 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019623    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:11.029749 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019627    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019631    2566 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019635    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019639    2566 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019646    2566 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019653    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019658    2566 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019662    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019666    2566 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019670    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019674    2566 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019679    2566 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019683    2566 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019687    2566 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019691    2566 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019696    2566 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019700    2566 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019704    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.019708    2566 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.026567    2566 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 20:38:11.030185 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.026581    2566 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.026597    2566 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.026601    2566 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026652    2566 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026657    2566 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026660    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026663    2566 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026666    2566 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026669    2566 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026672    2566 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026674    2566 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026677    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026681    2566 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026684    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026687    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026690    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026692    2566 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026695    2566 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026698    2566 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:11.030656 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026700    2566 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026703    2566 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026705    2566 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026708    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026710    2566 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026713    2566 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026715    2566 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026718    2566 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026720    2566 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026722    2566 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026725    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026728    2566 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026730    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026734    2566 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026737    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026740    2566 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026742    2566 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026744    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026747    2566 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:11.031085 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026750    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026752    2566 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026755    2566 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026757    2566 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026759    2566 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026762    2566 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026764    2566 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026766    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026769    2566 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026772    2566 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026774    2566 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026777    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026779    2566 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026782    2566 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026784    2566 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026787    2566 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026789    2566 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026792    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026794    2566 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026796    2566 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:11.031561 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026799    2566 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026801    2566 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026804    2566 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026806    2566 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026809    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026811    2566 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026814    2566 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026817    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026820    2566 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026822    2566 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026824    2566 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026827    2566 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026829    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026832    2566 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026834    2566 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026836    2566 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026839    2566 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026841    2566 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026843    2566 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026846    2566 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:11.032008 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026848    2566 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026851    2566 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026853    2566 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026855    2566 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026858    2566 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026861    2566 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026863    2566 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026865    2566 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026869    2566 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026873    2566 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026876    2566 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026879    2566 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026882    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026884    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026887    2566 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026889    2566 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026892    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026894    2566 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026896    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:11.032473 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026899    2566 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:11.032947 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026902    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:11.032947 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026905    2566 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:11.032947 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026907    2566 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:11.032947 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026909    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:11.032947 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026912    2566 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:11.032947 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026914    2566 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:11.032947 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026917    2566 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:11.032947 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026919    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:11.032947 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026922    2566 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:11.032947 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026924    2566 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:11.032947 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.026927    2566 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:11.032947 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.026952    2566 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:11.032947 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027083    2566 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:11.032947 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027087    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:11.032947 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027091    2566 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:11.032947 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027093    2566 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027096    2566 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027099    2566 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027101    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027104    2566 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027106    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027109    2566 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027111    2566 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027114    2566 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027117    2566 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027119    2566 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027121    2566 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027124    2566 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027126    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027129    2566 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027131    2566 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027134    2566 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027136    2566 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027139    2566 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:11.033316 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027141    2566 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027144    2566 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027147    2566 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027149    2566 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027152    2566 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027154    2566 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027157    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027160    2566 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027162    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027165    2566 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027167    2566 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027169    2566 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027172    2566 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027174    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027176    2566 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027179    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027181    2566 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027184    2566 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027186    2566 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027189    2566 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:11.033777 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027191    2566 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027193    2566 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027196    2566 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027200    2566 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027203    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027206    2566 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027209    2566 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027213    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027216    2566 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027220    2566 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027222    2566 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027225    2566 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027232    2566 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027235    2566 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027238    2566 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027240    2566 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027242    2566 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027245    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027248    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027250    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:11.034247 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027252    2566 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027255    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027257    2566 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027260    2566 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027263    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027265    2566 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027268    2566 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027271    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027273    2566 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027276    2566 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027278    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027280    2566 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027283    2566 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027285    2566 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027288    2566 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027292    2566 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027294    2566 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027297    2566 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027299    2566 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027302    2566 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:11.034811 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027304    2566 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027307    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027309    2566 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027312    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027314    2566 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027317    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027320    2566 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027322    2566 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027324    2566 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027327    2566 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027329    2566 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027332    2566 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027334    2566 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027337    2566 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027339    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027342    2566 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027344    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027346    2566 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027349    2566 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:11.035562 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027353    2566 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:11.036265 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027356    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:11.036265 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027371    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:11.036265 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027374    2566 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:11.036265 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027376    2566 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:11.036265 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.027399    2566 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:11.036265 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027435    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:11.036265 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027439    2566 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:11.036265 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027443    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:11.036265 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027446    2566 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:11.036265 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027448    2566 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:11.036265 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027451    2566 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:11.036265 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027453    2566 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:11.036265 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027456    2566 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:11.036265 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027458    2566 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:11.036265 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027461    2566 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027463    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027466    2566 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027468    2566 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027471    2566 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027474    2566 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027476    2566 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027479    2566 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027481    2566 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027484    2566 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027486    2566 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027489    2566 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027491    2566 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027494    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027496    2566 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027499    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027501    2566 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027503    2566 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027506    2566 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:11.036714 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027508    2566 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027511    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027513    2566 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027515    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027518    2566 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027521    2566 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027524    2566 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027527    2566 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027529    2566 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027531    2566 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027534    2566 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027536    2566 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027539    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027542    2566 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027545    2566 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027548    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027551    2566 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027554    2566 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027557    2566 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027559    2566 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:11.037193 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027562    2566 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027564    2566 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027567    2566 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027569    2566 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027571    2566 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027575    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027578    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027580    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027583    2566 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027585    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027588    2566 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027590    2566 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027593    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027595    2566 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027598    2566 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027600    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027602    2566 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027605    2566 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027608    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:11.037676 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027611    2566 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027614    2566 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027616    2566 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027618    2566 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027621    2566 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027624    2566 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027626    2566 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027629    2566 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027632    2566 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027634    2566 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027637    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027639    2566 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027642    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027644    2566 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027647    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027649    2566 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027652    2566 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027654    2566 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027658    2566 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027660    2566 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:11.038114 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027663    2566 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027665    2566 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027668    2566 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027670    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027673    2566 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027675    2566 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027678    2566 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027680    2566 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027684    2566 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027688    2566 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027690    2566 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027694    2566 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027698    2566 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027700    2566 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027703    2566 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027705    2566 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027707    2566 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027710    2566 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:11.027712    2566 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:11.038661 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.027761    2566 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 20:38:11.039084 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.030462    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 20:38:11.039084 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.031346    2566 server.go:1014] "Starting client certificate rotation"
Oct 30 20:38:11.039084 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.031449    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:38:11.039084 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.031484    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:38:11.039084 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.034041    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:38:11.039084 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.036188    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:38:11.048105 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.048082    2566 log.go:25] "Validated CRI v1 runtime API"
Oct 30 20:38:11.050595 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.050581    2566 log.go:25] "Validated CRI v1 image API"
Oct 30 20:38:11.051408 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.051374    2566 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 20:38:11.056654 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.056629    2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7b15490f-0794-4b40-87a1-85d86dad1b34:/dev/nvme0n1p4 f9a7aecc-6351-42ec-833b-0b6d4ae06089:/dev/nvme0n1p3]
Oct 30 20:38:11.056654 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.056648    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 20:38:11.061934 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.061834    2566 manager.go:217] Machine: {Timestamp:2026-10-30 20:38:11.060046721 +0000 UTC m=+0.350427639 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3201537 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b66d8beaa53ec1b24cdbd1b5f53d1 SystemUUID:ec2b66d8-beaa-53ec-1b24-cdbd1b5f53d1 BootID:124ff9b4-e197-40e1-9d84-a9ced9e25f1c Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c9:cb:15:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c9:cb:15:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:aa:d3:3b:77:f3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 20:38:11.061934 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.061930    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 20:38:11.062042 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.061996    2566 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 20:38:11.065278 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.065251    2566 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 20:38:11.065418 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.065277    2566 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-183.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 20:38:11.065465 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.065420    2566 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 20:38:11.065465 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.065428    2566 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 20:38:11.065465 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.065462    2566 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:38:11.065543 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.065480    2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:38:11.066690 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.066679    2566 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 20:38:11.068919 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.068904    2566 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 20:38:11.070316 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.070305    2566 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 20:38:11.070444 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.070434    2566 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 20:38:11.070475 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.070464    2566 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 20:38:11.070500 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.070484    2566 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 20:38:11.070525 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.070499    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 20:38:11.070525 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.070511    2566 kubelet.go:405] "Adding apiserver pod source"
Oct 30 20:38:11.070525 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.070522    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 20:38:11.070859 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.070824    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:38:11.073436 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.073399    2566 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 20:38:11.080239 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.080222    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:38:11.081008 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.080987    2566 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 20:38:11.081094 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.081033    2566 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 20:38:11.081223 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.081210    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 20:38:11.081283 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.081229    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 20:38:11.081283 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.081240    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 20:38:11.081283 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.081249    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 20:38:11.081283 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.081258    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 20:38:11.081283 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.081267    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 20:38:11.081861 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.081850    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 20:38:11.081910 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.081863    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 20:38:11.081910 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.081875    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 20:38:11.081910 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.081885    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 20:38:11.081910 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.081898    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 20:38:11.082080 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.081911    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 20:38:11.083492 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.083481    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 20:38:11.083557 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.083496    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 20:38:11.087233 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.087217    2566 server.go:1263] "Started kubelet"
Oct 30 20:38:11.087305 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.087281    2566 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 20:38:11.087405 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.087353    2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 20:38:11.087447 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.087428    2566 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 20:38:11.088373 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.088342    2566 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 20:38:11.088609 ip-10-0-142-183 systemd[1]: Started Kubernetes Kubelet.
Oct 30 20:38:11.089777 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.089604    2566 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 20:38:11.094823 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.094805    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 20:38:11.095958 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.095940    2566 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 20:38:11.096060 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.096044    2566 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-183.us-east-2.compute.internal\" not found"
Oct 30 20:38:11.096964 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.096945    2566 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 20:38:11.097062 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.097050    2566 factory.go:55] Registering systemd factory
Oct 30 20:38:11.097123 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.097064    2566 factory.go:223] Registration of the systemd container factory successfully
Oct 30 20:38:11.097197 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.097185    2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 20:38:11.097270 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.097246    2566 factory.go:153] Registering CRI-O factory
Oct 30 20:38:11.097270 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.097257    2566 factory.go:223] Registration of the crio container factory successfully
Oct 30 20:38:11.097401 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.097315    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 20:38:11.097401 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.097332    2566 factory.go:103] Registering Raw factory
Oct 30 20:38:11.097401 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.097345    2566 manager.go:1199] Started watching for new ooms in manager
Oct 30 20:38:11.098122 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.098086    2566 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 20:38:11.098122 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.098114    2566 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 20:38:11.098212 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.098201    2566 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 20:38:11.098212 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.098211    2566 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 20:38:11.098537 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.098524    2566 manager.go:319] Starting recovery of all containers
Oct 30 20:38:11.101785 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.101766    2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-183.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 20:38:11.102047 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.102027    2566 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-183.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 20:38:11.102235 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.102209    2566 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-183.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 20:38:11.102320 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.102294    2566 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 20:38:11.105490 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.102083    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-183.us-east-2.compute.internal.18e369269708c684  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-183.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-183.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 20:38:11.087197828 +0000 UTC m=+0.377578744,LastTimestamp:2026-10-30 20:38:11.087197828 +0000 UTC m=+0.377578744,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-183.us-east-2.compute.internal,}"
Oct 30 20:38:11.111423 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.111116    2566 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 30 20:38:11.112642 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.112627    2566 manager.go:324] Recovery completed
Oct 30 20:38:11.120037 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.120024    2566 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:11.121261 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.121243    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2wgxw"
Oct 30 20:38:11.121766 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.121753    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:11.121829 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.121776    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:11.121829 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.121785    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:11.122273 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.122257    2566 cpu_manager.go:226] "Starting" policy="none"
Oct 30 20:38:11.122273 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.122271    2566 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 20:38:11.122416 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.122287    2566 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 20:38:11.122416 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.122262    2566 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:11.123060 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.123046    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:11.123111 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.123075    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:11.123111 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.123090    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:11.124109 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.124040    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-183.us-east-2.compute.internal.18e3692699183a53  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-183.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-183.us-east-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-183.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 20:38:11.121764947 +0000 UTC m=+0.412145863,LastTimestamp:2026-10-30 20:38:11.121764947 +0000 UTC m=+0.412145863,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-183.us-east-2.compute.internal,}"
Oct 30 20:38:11.124266 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.124254    2566 policy_none.go:50] "Start"
Oct 30 20:38:11.124338 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.124273    2566 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 20:38:11.124338 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.124291    2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 20:38:11.126193 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.126180    2566 policy_none.go:44] "Start"
Oct 30 20:38:11.137179 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.137116    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-183.us-east-2.compute.internal.18e369269918768b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-183.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-183.us-east-2.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-183.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 20:38:11.121780363 +0000 UTC m=+0.412161279,LastTimestamp:2026-10-30 20:38:11.121780363 +0000 UTC m=+0.412161279,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-183.us-east-2.compute.internal,}"
Oct 30 20:38:11.138071 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.138054    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2wgxw"
Oct 30 20:38:11.176078 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.165739    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 20:38:11.176078 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.165944    2566 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 20:38:11.176078 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.166987    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 20:38:11.176078 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.167008    2566 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 20:38:11.176078 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.167026    2566 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 20:38:11.176078 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.167063    2566 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 20:38:11.176078 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.168876    2566 manager.go:341] "Starting Device Plugin manager"
Oct 30 20:38:11.176078 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.168916    2566 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 20:38:11.176078 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.168927    2566 server.go:87] "Starting device plugin registration server"
Oct 30 20:38:11.176078 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.169173    2566 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 20:38:11.176078 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.169301    2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 20:38:11.176078 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.169496    2566 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 20:38:11.176078 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.169573    2566 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 20:38:11.176078 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.169585    2566 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 20:38:11.176078 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.170002    2566 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 20:38:11.176078 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.170106    2566 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-183.us-east-2.compute.internal\" not found"
Oct 30 20:38:11.176078 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.170636    2566 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:11.267315 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.267272    2566 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal"]
Oct 30 20:38:11.267391 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.267322    2566 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:11.268032 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.268018    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:11.268087 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.268042    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:11.268087 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.268053    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:11.270171 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.270158    2566 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:11.270254 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.270192    2566 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:11.270295 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.270283    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.270327 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.270303    2566 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:11.274149 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.274132    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:11.274247 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.274159    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:11.274247 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.274174    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:11.274247 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.274138    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:11.274247 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.274213    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:11.274247 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.274227    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:11.274247 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.274231    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:11.274247 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.274242    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:11.274538 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.274245    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:11.274538 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.274339    2566 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.276472 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.276455    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.276538 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.276506    2566 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:11.277318 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.277293    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:11.277415 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.277328    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:11.277415 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.277338    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:11.286452 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.286435    2566 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.286506 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.286453    2566 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-183.us-east-2.compute.internal\": node \"ip-10-0-142-183.us-east-2.compute.internal\" not found"
Oct 30 20:38:11.299245 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.299224    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/289e7d851e39af0854a82e99a8d41138-config\") pod \"kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"289e7d851e39af0854a82e99a8d41138\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.299329 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.299261    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f4a5d3da19d20e6931f18f86a441dd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"5f4a5d3da19d20e6931f18f86a441dd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.299329 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.299295    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f4a5d3da19d20e6931f18f86a441dd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"5f4a5d3da19d20e6931f18f86a441dd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.299821 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.299806    2566 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-183.us-east-2.compute.internal\" not found" node="ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.302490 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.302473    2566 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-183.us-east-2.compute.internal\" not found" node="ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.343647 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.343630    2566 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-183.us-east-2.compute.internal\" not found"
Oct 30 20:38:11.400401 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.400381    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f4a5d3da19d20e6931f18f86a441dd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"5f4a5d3da19d20e6931f18f86a441dd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.400401 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.400397    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f4a5d3da19d20e6931f18f86a441dd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"5f4a5d3da19d20e6931f18f86a441dd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.400525 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.400416    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f4a5d3da19d20e6931f18f86a441dd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"5f4a5d3da19d20e6931f18f86a441dd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.400525 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.400496    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/289e7d851e39af0854a82e99a8d41138-config\") pod \"kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"289e7d851e39af0854a82e99a8d41138\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.400525 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.400520    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/289e7d851e39af0854a82e99a8d41138-config\") pod \"kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"289e7d851e39af0854a82e99a8d41138\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.400620 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.400535    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f4a5d3da19d20e6931f18f86a441dd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"5f4a5d3da19d20e6931f18f86a441dd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.444034 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.444017    2566 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-183.us-east-2.compute.internal\" not found"
Oct 30 20:38:11.544681 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.544642    2566 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-183.us-east-2.compute.internal\" not found"
Oct 30 20:38:11.603230 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.603209    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.606082 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:11.606071    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:11.644810 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.644791    2566 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-183.us-east-2.compute.internal\" not found"
Oct 30 20:38:11.745302 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.745281    2566 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-183.us-east-2.compute.internal\" not found"
Oct 30 20:38:11.845819 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.845784    2566 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-183.us-east-2.compute.internal\" not found"
Oct 30 20:38:11.946305 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:11.946285    2566 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-183.us-east-2.compute.internal\" not found"
Oct 30 20:38:12.031326 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:12.031310    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 20:38:12.031631 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:12.031439    2566 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 20:38:12.046397 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:12.046378    2566 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-183.us-east-2.compute.internal\" not found"
Oct 30 20:38:12.146658 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:12.146609    2566 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-183.us-east-2.compute.internal\" not found"
Oct 30 20:38:12.146737 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:12.146648    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 20:33:11 +0000 UTC" deadline="2028-06-30 15:13:13.79169601 +0000 UTC"
Oct 30 20:38:12.146737 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:12.146676    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14610h35m1.645023473s"
Oct 30 20:38:12.247358 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:12.247329    2566 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-183.us-east-2.compute.internal\" not found"
Oct 30 20:38:12.258589 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:12.258567    2566 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:12.259756 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:12.259740    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:12.259821 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:12.259775    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:12.259821 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:12.259788    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:12.319670 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:12.319637    2566 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4a5d3da19d20e6931f18f86a441dd3.slice/crio-e5acf9f9d41e2b99f41fdb1f8e26624d5c17ee0caee498d1ecf395ee5b7f3fc1 WatchSource:0}: Error finding container e5acf9f9d41e2b99f41fdb1f8e26624d5c17ee0caee498d1ecf395ee5b7f3fc1: Status 404 returned error can't find the container with id e5acf9f9d41e2b99f41fdb1f8e26624d5c17ee0caee498d1ecf395ee5b7f3fc1
Oct 30 20:38:12.326041 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:12.326026    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:38:12.328897 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:12.328874    2566 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod289e7d851e39af0854a82e99a8d41138.slice/crio-b37c02572e3aa5c5eb7774ce952dfd2a84d29c5bcc98fd5a7e661bf34c66f1e3 WatchSource:0}: Error finding container b37c02572e3aa5c5eb7774ce952dfd2a84d29c5bcc98fd5a7e661bf34c66f1e3: Status 404 returned error can't find the container with id b37c02572e3aa5c5eb7774ce952dfd2a84d29c5bcc98fd5a7e661bf34c66f1e3
Oct 30 20:38:12.347981 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:12.347961    2566 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-183.us-east-2.compute.internal\" not found"
Oct 30 20:38:12.414041 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:12.413994    2566 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:12.470567 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:12.470550    2566 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:12.497415 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:12.497383    2566 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:12.510927 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:12.510911    2566 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:12.512010 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:12.511998    2566 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:12.530507 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:12.530493    2566 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:12.626937 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:12.626920    2566 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:12.916212 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:12.916193    2566 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:13.072549 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.072530    2566 apiserver.go:52] "Watching apiserver"
Oct 30 20:38:13.081946 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.081903    2566 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 20:38:13.082280 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.082253    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jk8sp","kube-system/konnectivity-agent-7wl8g","kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal","openshift-cluster-node-tuning-operator/tuned-kbbkm","openshift-multus/multus-additional-cni-plugins-rs9rh","openshift-multus/network-metrics-daemon-n7qt5","openshift-network-diagnostics/network-check-target-qwmdw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5","openshift-dns/node-resolver-8g6wj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal","openshift-multus/multus-rt5dq","openshift-image-registry/node-ca-778mq","openshift-network-operator/iptables-alerter-xkzc8","openshift-ovn-kubernetes/ovnkube-node-6nqrx"]
Oct 30 20:38:13.084821 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.084800    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.087875 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.087364    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7wl8g"
Oct 30 20:38:13.088881 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.088861    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:13.091992 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.091974    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 20:38:13.092099 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.092062    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9r6zk\""
Oct 30 20:38:13.092167 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.092142    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:13.092254 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.092240    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 20:38:13.092363 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.092350    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-r2q8w\""
Oct 30 20:38:13.092467 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.092453    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:13.092548 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.092527    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwmdw" podUID="cf3347a5-26a7-4708-abb3-e3a39308f782"
Oct 30 20:38:13.092611 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.092580    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.094664 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.094640    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:13.094756 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.094717    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7qt5" podUID="88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c"
Oct 30 20:38:13.096744 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.096725    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 20:38:13.096744 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.096737    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 20:38:13.096907 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.096814    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 20:38:13.096907 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.096859    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 20:38:13.096907 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.096880    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 20:38:13.097060 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.096941    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jrnvk\""
Oct 30 20:38:13.097060 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.097051    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:13.097169 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.097101    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8sp" podUID="34e89d20-b285-4246-8184-9fe736a2c6fb"
Oct 30 20:38:13.097169 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.097115    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 20:38:13.100678 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.100658    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.103025 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.103004    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:13.105689 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.105667    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.109081 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.109058    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:13.111121 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111097    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-registration-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.111220 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111145    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-etc-selinux\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.111287 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111180    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34e89d20-b285-4246-8184-9fe736a2c6fb-kubelet-config\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:13.111287 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111262    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-sys-fs\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.111414 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111298    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt972\" (UniqueName: \"kubernetes.io/projected/34f5534a-5450-43a0-8d78-bc7e362bcfa9-kube-api-access-jt972\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.111414 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111355    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-tmp\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.111414 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111391    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbtq7\" (UniqueName: \"kubernetes.io/projected/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-kube-api-access-nbtq7\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.111574 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111427    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c9a4a383-c9b9-4475-b22e-d336d1a35422-agent-certs\") pod \"konnectivity-agent-7wl8g\" (UID: \"c9a4a383-c9b9-4475-b22e-d336d1a35422\") " pod="kube-system/konnectivity-agent-7wl8g"
Oct 30 20:38:13.111574 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111454    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz6t9\" (UniqueName: \"kubernetes.io/projected/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-kube-api-access-wz6t9\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:13.111574 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111479    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:13.111574 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111502    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-run\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.111574 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111536    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-var-lib-kubelet\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.111574 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111563    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-device-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.111877 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111608    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:13.111877 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111636    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.111877 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111666    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.111877 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111690    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-modprobe-d\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.111877 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111729    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-lib-modules\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.111877 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111752    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:13.112212 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.111757    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvkf4\" (UniqueName: \"kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4\") pod \"network-check-target-qwmdw\" (UID: \"cf3347a5-26a7-4708-abb3-e3a39308f782\") " pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:13.112212 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.112101    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-kubernetes\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.112212 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.112129    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-systemd\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.112212 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.112170    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-sys\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.112212 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.112211    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-host\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.112497 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.112234    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-cnibin\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.112497 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.112263    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kfg8\" (UniqueName: \"kubernetes.io/projected/f7716064-3190-400e-be69-91ee32a14749-kube-api-access-2kfg8\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.112497 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.112288    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysctl-conf\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.112497 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.112312    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-cni-binary-copy\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.113501 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.113430    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysconfig\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.113583 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.113532    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysctl-d\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.113973 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.113951    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-tuned\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.114125 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.114100    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.114505 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.114479    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c9a4a383-c9b9-4475-b22e-d336d1a35422-konnectivity-ca\") pod \"konnectivity-agent-7wl8g\" (UID: \"c9a4a383-c9b9-4475-b22e-d336d1a35422\") " pod="kube-system/konnectivity-agent-7wl8g"
Oct 30 20:38:13.115066 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.115006    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34e89d20-b285-4246-8184-9fe736a2c6fb-dbus\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:13.115168 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.115098    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-system-cni-dir\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.115237 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.115172    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.115294 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.115239    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.115294 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.115268    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-socket-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.171571 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.171497    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal" event={"ID":"5f4a5d3da19d20e6931f18f86a441dd3","Type":"ContainerStarted","Data":"e5acf9f9d41e2b99f41fdb1f8e26624d5c17ee0caee498d1ecf395ee5b7f3fc1"}
Oct 30 20:38:13.173425 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.173399    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal" event={"ID":"289e7d851e39af0854a82e99a8d41138","Type":"ContainerStarted","Data":"b37c02572e3aa5c5eb7774ce952dfd2a84d29c5bcc98fd5a7e661bf34c66f1e3"}
Oct 30 20:38:13.197380 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.197359    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 20:38:13.197511 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.197491    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 20:38:13.197693 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.197673    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:13.197772 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.197731    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 20:38:13.197772 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.197764    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 20:38:13.197870 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.197834    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 20:38:13.197922 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.197904    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 20:38:13.197973 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.197926    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 20:38:13.198025 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.198005    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nxdl7\""
Oct 30 20:38:13.198060 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.198050    2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 20:38:13.198099 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.198066    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 20:38:13.198166 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.198139    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 20:38:13.199110 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.199090    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9s58x\""
Oct 30 20:38:13.199272 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.199241    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 20:38:13.199364 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.199349    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-wzc24\""
Oct 30 20:38:13.199737 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.199660    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 20:38:13.199737 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.199693    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 20:38:13.199737 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.199720    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 20:38:13.199929 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.199754    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 20:38:13.199929 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.199758    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:13.200496 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.200478    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 20:38:13.201250 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.201048    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z6v2d\""
Oct 30 20:38:13.201250 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.201087    2566 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 20:38:13.201250 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.201116    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 20:38:13.201250 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.201145    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cctqn\""
Oct 30 20:38:13.201250 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.201168    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bmr8k"
Oct 30 20:38:13.201250 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.201220    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mnk4k\""
Oct 30 20:38:13.212968 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.212573    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bmr8k"
Oct 30 20:38:13.215387 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215369    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-cnibin\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.215496 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215410    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kfg8\" (UniqueName: \"kubernetes.io/projected/f7716064-3190-400e-be69-91ee32a14749-kube-api-access-2kfg8\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.215496 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215438    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysctl-conf\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.215496 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215464    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-run-netns\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.215496 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215487    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-ovn\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.215704 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215496    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-cnibin\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.215704 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215512    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-systemd\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.215704 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215537    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysconfig\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.215704 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215560    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysctl-d\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.215704 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215585    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-kubelet\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.215704 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215611    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34e89d20-b285-4246-8184-9fe736a2c6fb-dbus\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:13.215704 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215637    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.215704 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215641    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysctl-conf\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.215704 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215662    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.215704 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215688    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-socket-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.216388 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215713    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-slash\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.216388 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215754    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.216388 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215783    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0f30507-57cb-4145-bd0c-f44b3698d7ab-host\") pod \"node-ca-778mq\" (UID: \"f0f30507-57cb-4145-bd0c-f44b3698d7ab\") " pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:13.216388 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215804    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0f30507-57cb-4145-bd0c-f44b3698d7ab-serviceca\") pod \"node-ca-778mq\" (UID: \"f0f30507-57cb-4145-bd0c-f44b3698d7ab\") " pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:13.216388 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215954    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34e89d20-b285-4246-8184-9fe736a2c6fb-dbus\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:13.216388 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.215998    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-cni-bin\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.216388 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216033    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovnkube-script-lib\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.216388 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216060    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-system-cni-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.216388 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216074    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.216388 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216074    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysctl-d\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.216388 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216084    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-netns\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.216388 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216074    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-socket-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.216388 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216109    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysconfig\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.216388 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216124    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-hostroot\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.216388 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216232    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:13.216388 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216263    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-cni-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.216388 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216291    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-cni-multus\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.217218 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216335    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-var-lib-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.217218 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216358    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/571e6927-684b-4d97-b9ab-4d2581d5235a-hosts-file\") pod \"node-resolver-8g6wj\" (UID: \"571e6927-684b-4d97-b9ab-4d2581d5235a\") " pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:13.217218 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216389    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.217218 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.216403    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:13.217218 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216421    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87b38c08-ae1d-4961-bd80-f0198dec4a22-cni-binary-copy\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.217218 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216424    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.217218 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216438    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.217218 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.216516    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret podName:34e89d20-b285-4246-8184-9fe736a2c6fb nodeName:}" failed. No retries permitted until 2026-10-30 20:38:13.716457813 +0000 UTC m=+3.006838753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret") pod "global-pull-secret-syncer-jk8sp" (UID: "34e89d20-b285-4246-8184-9fe736a2c6fb") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:13.217218 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216543    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-conf-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.217218 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216578    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-daemon-config\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.217218 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216629    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvkf4\" (UniqueName: \"kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4\") pod \"network-check-target-qwmdw\" (UID: \"cf3347a5-26a7-4708-abb3-e3a39308f782\") " pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:13.217218 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216864    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-systemd\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.217218 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216932    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-host\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.217218 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216968    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06028e29-e135-48d5-aa5d-2c625009150d-host-slash\") pod \"iptables-alerter-xkzc8\" (UID: \"06028e29-e135-48d5-aa5d-2c625009150d\") " pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:13.217218 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216996    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovn-node-metrics-cert\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.217218 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.216934    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-systemd\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.218153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217022    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-cni-netd\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.218153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217072    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-host\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.218153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217109    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-kubelet\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.218153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217138    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-cni-binary-copy\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.218153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217164    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-tuned\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.218153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217197    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c9a4a383-c9b9-4475-b22e-d336d1a35422-konnectivity-ca\") pod \"konnectivity-agent-7wl8g\" (UID: \"c9a4a383-c9b9-4475-b22e-d336d1a35422\") " pod="kube-system/konnectivity-agent-7wl8g"
Oct 30 20:38:13.218153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217222    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv82j\" (UniqueName: \"kubernetes.io/projected/f0f30507-57cb-4145-bd0c-f44b3698d7ab-kube-api-access-rv82j\") pod \"node-ca-778mq\" (UID: \"f0f30507-57cb-4145-bd0c-f44b3698d7ab\") " pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:13.218153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217257    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-systemd-units\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.218153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217285    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tk25\" (UniqueName: \"kubernetes.io/projected/571e6927-684b-4d97-b9ab-4d2581d5235a-kube-api-access-7tk25\") pod \"node-resolver-8g6wj\" (UID: \"571e6927-684b-4d97-b9ab-4d2581d5235a\") " pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:13.218153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217312    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-etc-kubernetes\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.218153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217347    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-system-cni-dir\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.218153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217374    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-registration-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.218153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217399    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-etc-selinux\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.218153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217444    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-sys-fs\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.218153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217472    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c9a4a383-c9b9-4475-b22e-d336d1a35422-agent-certs\") pod \"konnectivity-agent-7wl8g\" (UID: \"c9a4a383-c9b9-4475-b22e-d336d1a35422\") " pod="kube-system/konnectivity-agent-7wl8g"
Oct 30 20:38:13.218153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217498    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz6t9\" (UniqueName: \"kubernetes.io/projected/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-kube-api-access-wz6t9\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:13.218153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217536    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-node-log\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.219161 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217559    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-cnibin\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.219161 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217592    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34e89d20-b285-4246-8184-9fe736a2c6fb-kubelet-config\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:13.219161 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217616    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt972\" (UniqueName: \"kubernetes.io/projected/34f5534a-5450-43a0-8d78-bc7e362bcfa9-kube-api-access-jt972\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.219161 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217639    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-tmp\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.219161 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217670    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbtq7\" (UniqueName: \"kubernetes.io/projected/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-kube-api-access-nbtq7\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.219161 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217695    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-env-overrides\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.219161 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217723    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-socket-dir-parent\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.219161 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217760    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-k8s-cni-cncf-io\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.219161 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217791    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-run\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.219161 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217818    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-var-lib-kubelet\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.219161 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217843    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-etc-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.219161 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217869    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovnkube-config\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.219161 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217896    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-device-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.219161 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217921    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:13.219161 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217947    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2v6p\" (UniqueName: \"kubernetes.io/projected/06028e29-e135-48d5-aa5d-2c625009150d-kube-api-access-f2v6p\") pod \"iptables-alerter-xkzc8\" (UID: \"06028e29-e135-48d5-aa5d-2c625009150d\") " pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:13.219161 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.217972    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.219161 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.218010    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-log-socket\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.218041    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-cni-bin\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.218067    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-multus-certs\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.218095    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.218123    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-modprobe-d\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.218147    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-lib-modules\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.218172    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/06028e29-e135-48d5-aa5d-2c625009150d-iptables-alerter-script\") pod \"iptables-alerter-xkzc8\" (UID: \"06028e29-e135-48d5-aa5d-2c625009150d\") " pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.218200    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slmhq\" (UniqueName: \"kubernetes.io/projected/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-kube-api-access-slmhq\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.218224    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571e6927-684b-4d97-b9ab-4d2581d5235a-tmp-dir\") pod \"node-resolver-8g6wj\" (UID: \"571e6927-684b-4d97-b9ab-4d2581d5235a\") " pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.218256    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4psg6\" (UniqueName: \"kubernetes.io/projected/87b38c08-ae1d-4961-bd80-f0198dec4a22-kube-api-access-4psg6\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.218283    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-kubernetes\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.218307    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-sys\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.218332    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.218892    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-cni-binary-copy\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.219163    2566 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.219589    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-run\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.219655    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-var-lib-kubelet\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.219683    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c9a4a383-c9b9-4475-b22e-d336d1a35422-konnectivity-ca\") pod \"konnectivity-agent-7wl8g\" (UID: \"c9a4a383-c9b9-4475-b22e-d336d1a35422\") " pod="kube-system/konnectivity-agent-7wl8g"
Oct 30 20:38:13.219971 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.219775    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:13.221009 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.219775    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-device-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.221009 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.219811    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs podName:88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:13.719799502 +0000 UTC m=+3.010180409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs") pod "network-metrics-daemon-n7qt5" (UID: "88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:13.221009 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.219884    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-registration-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.221009 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.219935    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-system-cni-dir\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.221009 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.220366    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-modprobe-d\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.221009 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.220453    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.221009 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.220598    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-lib-modules\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.221009 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.220614    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-etc-selinux\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.222057 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.222032    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34e89d20-b285-4246-8184-9fe736a2c6fb-kubelet-config\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:13.222153 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.222121    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-sys-fs\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.222399 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.222372    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-kubernetes\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.222490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.222462    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-sys\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.223886 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.223860    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c9a4a383-c9b9-4475-b22e-d336d1a35422-agent-certs\") pod \"konnectivity-agent-7wl8g\" (UID: \"c9a4a383-c9b9-4475-b22e-d336d1a35422\") " pod="kube-system/konnectivity-agent-7wl8g"
Oct 30 20:38:13.224743 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.224717    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-tmp\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.225820 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.225794    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-tuned\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.229805 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.229785    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kfg8\" (UniqueName: \"kubernetes.io/projected/f7716064-3190-400e-be69-91ee32a14749-kube-api-access-2kfg8\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.233367 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.233345    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:13.233367 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.233370    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:13.233498 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.233383    2566 projected.go:196] Error preparing data for projected volume kube-api-access-dvkf4 for pod openshift-network-diagnostics/network-check-target-qwmdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:13.233498 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.233447    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4 podName:cf3347a5-26a7-4708-abb3-e3a39308f782 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:13.733435015 +0000 UTC m=+3.023815936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dvkf4" (UniqueName: "kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4") pod "network-check-target-qwmdw" (UID: "cf3347a5-26a7-4708-abb3-e3a39308f782") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:13.237679 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.237651    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbtq7\" (UniqueName: \"kubernetes.io/projected/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-kube-api-access-nbtq7\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.238397 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.238370    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt972\" (UniqueName: \"kubernetes.io/projected/34f5534a-5450-43a0-8d78-bc7e362bcfa9-kube-api-access-jt972\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.238911 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.238886    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz6t9\" (UniqueName: \"kubernetes.io/projected/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-kube-api-access-wz6t9\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:13.318925 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.318897    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-run-netns\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319048 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.318939    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-ovn\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319048 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.318964    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-systemd\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319048 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.318988    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-kubelet\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319048 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319009    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-run-netns\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319048 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319026    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-ovn\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319313 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319050    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-systemd\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319313 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319058    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-slash\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319313 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319015    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-slash\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319313 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319089    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319313 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319095    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-kubelet\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319313 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319106    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0f30507-57cb-4145-bd0c-f44b3698d7ab-host\") pod \"node-ca-778mq\" (UID: \"f0f30507-57cb-4145-bd0c-f44b3698d7ab\") " pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:13.319313 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319135    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0f30507-57cb-4145-bd0c-f44b3698d7ab-serviceca\") pod \"node-ca-778mq\" (UID: \"f0f30507-57cb-4145-bd0c-f44b3698d7ab\") " pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:13.319313 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319163    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-cni-bin\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319313 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319187    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovnkube-script-lib\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319313 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319211    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-system-cni-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.319313 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319235    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-netns\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.319313 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319259    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-hostroot\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.319313 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319299    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-cni-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319324    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-cni-multus\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319349    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-var-lib-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319400    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/571e6927-684b-4d97-b9ab-4d2581d5235a-hosts-file\") pod \"node-resolver-8g6wj\" (UID: \"571e6927-684b-4d97-b9ab-4d2581d5235a\") " pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319427    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87b38c08-ae1d-4961-bd80-f0198dec4a22-cni-binary-copy\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319451    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-conf-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319486    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-daemon-config\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319525    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06028e29-e135-48d5-aa5d-2c625009150d-host-slash\") pod \"iptables-alerter-xkzc8\" (UID: \"06028e29-e135-48d5-aa5d-2c625009150d\") " pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319551    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovn-node-metrics-cert\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319575    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-cni-netd\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319606    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-kubelet\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319616    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319635    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv82j\" (UniqueName: \"kubernetes.io/projected/f0f30507-57cb-4145-bd0c-f44b3698d7ab-kube-api-access-rv82j\") pod \"node-ca-778mq\" (UID: \"f0f30507-57cb-4145-bd0c-f44b3698d7ab\") " pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319659    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-systemd-units\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319668    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0f30507-57cb-4145-bd0c-f44b3698d7ab-host\") pod \"node-ca-778mq\" (UID: \"f0f30507-57cb-4145-bd0c-f44b3698d7ab\") " pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319684    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tk25\" (UniqueName: \"kubernetes.io/projected/571e6927-684b-4d97-b9ab-4d2581d5235a-kube-api-access-7tk25\") pod \"node-resolver-8g6wj\" (UID: \"571e6927-684b-4d97-b9ab-4d2581d5235a\") " pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319710    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-etc-kubernetes\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319740    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/571e6927-684b-4d97-b9ab-4d2581d5235a-hosts-file\") pod \"node-resolver-8g6wj\" (UID: \"571e6927-684b-4d97-b9ab-4d2581d5235a\") " pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:13.319999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319744    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-node-log\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.321659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319771    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-cnibin\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.321659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319803    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-env-overrides\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.321659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319834    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-socket-dir-parent\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.321659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319860    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-k8s-cni-cncf-io\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.321659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319890    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-etc-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.321659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319914    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovnkube-config\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.321659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319952    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2v6p\" (UniqueName: \"kubernetes.io/projected/06028e29-e135-48d5-aa5d-2c625009150d-kube-api-access-f2v6p\") pod \"iptables-alerter-xkzc8\" (UID: \"06028e29-e135-48d5-aa5d-2c625009150d\") " pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:13.321659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.319978    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.321659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320005    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-log-socket\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.321659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320030    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-cni-bin\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.321659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320048    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-system-cni-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.321659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320056    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-multus-certs\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.321659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320091    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-netns\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.321659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320090    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/06028e29-e135-48d5-aa5d-2c625009150d-iptables-alerter-script\") pod \"iptables-alerter-xkzc8\" (UID: \"06028e29-e135-48d5-aa5d-2c625009150d\") " pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:13.321659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320121    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slmhq\" (UniqueName: \"kubernetes.io/projected/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-kube-api-access-slmhq\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.321659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320142    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571e6927-684b-4d97-b9ab-4d2581d5235a-tmp-dir\") pod \"node-resolver-8g6wj\" (UID: \"571e6927-684b-4d97-b9ab-4d2581d5235a\") " pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:13.321659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320175    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4psg6\" (UniqueName: \"kubernetes.io/projected/87b38c08-ae1d-4961-bd80-f0198dec4a22-kube-api-access-4psg6\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320218    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320275    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-cni-netd\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320332    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-kubelet\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320361    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-cni-multus\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320306    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-var-lib-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320414    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06028e29-e135-48d5-aa5d-2c625009150d-host-slash\") pod \"iptables-alerter-xkzc8\" (UID: \"06028e29-e135-48d5-aa5d-2c625009150d\") " pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320383    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-conf-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320466    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-cni-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320302    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-hostroot\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320504    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-cni-bin\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320567    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-cnibin\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320710    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-etc-kubernetes\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320259    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-node-log\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320823    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-systemd-units\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320284    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.320954    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.321001    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-k8s-cni-cncf-io\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.322458 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.321008    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-socket-dir-parent\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.323306 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.321069    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-etc-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.323306 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.321078    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-cni-bin\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.323306 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.321087    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-log-socket\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.323306 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.321109    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-multus-certs\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.323306 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.321325    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0f30507-57cb-4145-bd0c-f44b3698d7ab-serviceca\") pod \"node-ca-778mq\" (UID: \"f0f30507-57cb-4145-bd0c-f44b3698d7ab\") " pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:13.323306 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.321727    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571e6927-684b-4d97-b9ab-4d2581d5235a-tmp-dir\") pod \"node-resolver-8g6wj\" (UID: \"571e6927-684b-4d97-b9ab-4d2581d5235a\") " pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:13.323306 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.321729    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovnkube-script-lib\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.323306 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.322012    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-env-overrides\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.323306 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.322036    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/06028e29-e135-48d5-aa5d-2c625009150d-iptables-alerter-script\") pod \"iptables-alerter-xkzc8\" (UID: \"06028e29-e135-48d5-aa5d-2c625009150d\") " pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:13.323306 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.322214    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-daemon-config\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.323306 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.322991    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87b38c08-ae1d-4961-bd80-f0198dec4a22-cni-binary-copy\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.323306 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.323161    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovnkube-config\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.323875 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.323719    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovn-node-metrics-cert\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.334625 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.334604    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4psg6\" (UniqueName: \"kubernetes.io/projected/87b38c08-ae1d-4961-bd80-f0198dec4a22-kube-api-access-4psg6\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.335090 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.335067    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slmhq\" (UniqueName: \"kubernetes.io/projected/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-kube-api-access-slmhq\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.335796 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.335753    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv82j\" (UniqueName: \"kubernetes.io/projected/f0f30507-57cb-4145-bd0c-f44b3698d7ab-kube-api-access-rv82j\") pod \"node-ca-778mq\" (UID: \"f0f30507-57cb-4145-bd0c-f44b3698d7ab\") " pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:13.336327 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.336297    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tk25\" (UniqueName: \"kubernetes.io/projected/571e6927-684b-4d97-b9ab-4d2581d5235a-kube-api-access-7tk25\") pod \"node-resolver-8g6wj\" (UID: \"571e6927-684b-4d97-b9ab-4d2581d5235a\") " pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:13.340258 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.340234    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2v6p\" (UniqueName: \"kubernetes.io/projected/06028e29-e135-48d5-aa5d-2c625009150d-kube-api-access-f2v6p\") pod \"iptables-alerter-xkzc8\" (UID: \"06028e29-e135-48d5-aa5d-2c625009150d\") " pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:13.402512 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.402490    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:13.411272 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.411248    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7wl8g"
Oct 30 20:38:13.414885 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:13.414858    2566 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb502ddfa_b655_45b6_9b0f_e936f85a0fcb.slice/crio-a8a77a08719b989b1e7df07c3e095d8ed7812281e5cb6c2be3e1507dd58c0d48 WatchSource:0}: Error finding container a8a77a08719b989b1e7df07c3e095d8ed7812281e5cb6c2be3e1507dd58c0d48: Status 404 returned error can't find the container with id a8a77a08719b989b1e7df07c3e095d8ed7812281e5cb6c2be3e1507dd58c0d48
Oct 30 20:38:13.420896 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:13.420873    2566 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9a4a383_c9b9_4475_b22e_d336d1a35422.slice/crio-8885b3e0bc755f3c351c4c0612f02d4ba533ef40b9bcdd1c6aebc0e48b8bcac8 WatchSource:0}: Error finding container 8885b3e0bc755f3c351c4c0612f02d4ba533ef40b9bcdd1c6aebc0e48b8bcac8: Status 404 returned error can't find the container with id 8885b3e0bc755f3c351c4c0612f02d4ba533ef40b9bcdd1c6aebc0e48b8bcac8
Oct 30 20:38:13.441841 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.441812    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:13.442906 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.442883    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:13.445040 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.445020    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:13.447134 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.447111    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:13.454206 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:13.454184    2566 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7716064_3190_400e_be69_91ee32a14749.slice/crio-f4e6295e91d8bd1ec31f9910dbc37f59be31ade334afb64407d712fa7867a867 WatchSource:0}: Error finding container f4e6295e91d8bd1ec31f9910dbc37f59be31ade334afb64407d712fa7867a867: Status 404 returned error can't find the container with id f4e6295e91d8bd1ec31f9910dbc37f59be31ade334afb64407d712fa7867a867
Oct 30 20:38:13.454516 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.454496    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:13.467243 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.467220    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:13.474564 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:13.474536    2566 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f30507_57cb_4145_bd0c_f44b3698d7ab.slice/crio-a4d5362266ab2212469a899626f8f64302ff00821e197d500eae72bd69b2a1fc WatchSource:0}: Error finding container a4d5362266ab2212469a899626f8f64302ff00821e197d500eae72bd69b2a1fc: Status 404 returned error can't find the container with id a4d5362266ab2212469a899626f8f64302ff00821e197d500eae72bd69b2a1fc
Oct 30 20:38:13.480960 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:13.480936    2566 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06028e29_e135_48d5_aa5d_2c625009150d.slice/crio-63b63a04ff0364b1069ab2c6e93940e4be8850e888e6b4ff1d5c79e32b629874 WatchSource:0}: Error finding container 63b63a04ff0364b1069ab2c6e93940e4be8850e888e6b4ff1d5c79e32b629874: Status 404 returned error can't find the container with id 63b63a04ff0364b1069ab2c6e93940e4be8850e888e6b4ff1d5c79e32b629874
Oct 30 20:38:13.495023 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.494998    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:13.505256 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:13.505231    2566 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9f4ae35_3ffe_4d5d_b2a2_d32073d63bf0.slice/crio-49a6b9a89803a6c4afd76d670e192c11e3a23f0a489ac3644318bb85a37ddedf WatchSource:0}: Error finding container 49a6b9a89803a6c4afd76d670e192c11e3a23f0a489ac3644318bb85a37ddedf: Status 404 returned error can't find the container with id 49a6b9a89803a6c4afd76d670e192c11e3a23f0a489ac3644318bb85a37ddedf
Oct 30 20:38:13.723334 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.723244    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:13.723334 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.723316    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:13.723574 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.723404    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:13.723574 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.723447    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:13.723574 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.723477    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs podName:88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:14.723454784 +0000 UTC m=+4.013835690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs") pod "network-metrics-daemon-n7qt5" (UID: "88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:13.723574 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.723501    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret podName:34e89d20-b285-4246-8184-9fe736a2c6fb nodeName:}" failed. No retries permitted until 2026-10-30 20:38:14.723490915 +0000 UTC m=+4.013871823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret") pod "global-pull-secret-syncer-jk8sp" (UID: "34e89d20-b285-4246-8184-9fe736a2c6fb") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:13.824029 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:13.823991    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvkf4\" (UniqueName: \"kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4\") pod \"network-check-target-qwmdw\" (UID: \"cf3347a5-26a7-4708-abb3-e3a39308f782\") " pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:13.824193 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.824141    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:13.824193 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.824155    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:13.824193 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.824165    2566 projected.go:196] Error preparing data for projected volume kube-api-access-dvkf4 for pod openshift-network-diagnostics/network-check-target-qwmdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:13.824353 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:13.824242    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4 podName:cf3347a5-26a7-4708-abb3-e3a39308f782 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:14.82422463 +0000 UTC m=+4.114605544 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dvkf4" (UniqueName: "kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4") pod "network-check-target-qwmdw" (UID: "cf3347a5-26a7-4708-abb3-e3a39308f782") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:14.215632 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:14.215511    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:33:13 +0000 UTC" deadline="2028-04-11 09:40:26.09408351 +0000 UTC"
Oct 30 20:38:14.215632 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:14.215572    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12685h2m11.878515758s"
Oct 30 20:38:14.217358 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:14.217089    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rt5dq" event={"ID":"87b38c08-ae1d-4961-bd80-f0198dec4a22","Type":"ContainerStarted","Data":"579717f015c674d784f496845ac7acf50ff658304e5946c01b0ac7a8d03d7d1c"}
Oct 30 20:38:14.222489 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:14.222377    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5" event={"ID":"34f5534a-5450-43a0-8d78-bc7e362bcfa9","Type":"ContainerStarted","Data":"9768a32130d2b00158440282b8dbb987743b18c902da71fc1fc6975c1d9c8d9e"}
Oct 30 20:38:14.226389 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:14.226082    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rs9rh" event={"ID":"f7716064-3190-400e-be69-91ee32a14749","Type":"ContainerStarted","Data":"f4e6295e91d8bd1ec31f9910dbc37f59be31ade334afb64407d712fa7867a867"}
Oct 30 20:38:14.234470 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:14.234372    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7wl8g" event={"ID":"c9a4a383-c9b9-4475-b22e-d336d1a35422","Type":"ContainerStarted","Data":"8885b3e0bc755f3c351c4c0612f02d4ba533ef40b9bcdd1c6aebc0e48b8bcac8"}
Oct 30 20:38:14.254603 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:14.254577    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kbbkm" event={"ID":"b502ddfa-b655-45b6-9b0f-e936f85a0fcb","Type":"ContainerStarted","Data":"a8a77a08719b989b1e7df07c3e095d8ed7812281e5cb6c2be3e1507dd58c0d48"}
Oct 30 20:38:14.266679 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:14.266651    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx" event={"ID":"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0","Type":"ContainerStarted","Data":"49a6b9a89803a6c4afd76d670e192c11e3a23f0a489ac3644318bb85a37ddedf"}
Oct 30 20:38:14.287775 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:14.287744    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xkzc8" event={"ID":"06028e29-e135-48d5-aa5d-2c625009150d","Type":"ContainerStarted","Data":"63b63a04ff0364b1069ab2c6e93940e4be8850e888e6b4ff1d5c79e32b629874"}
Oct 30 20:38:14.299199 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:14.299170    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8g6wj" event={"ID":"571e6927-684b-4d97-b9ab-4d2581d5235a","Type":"ContainerStarted","Data":"8a82aecbf31cc1d034b831436afe9536b72319045a83e37c060b0cac3183e5b7"}
Oct 30 20:38:14.306994 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:14.306966    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-778mq" event={"ID":"f0f30507-57cb-4145-bd0c-f44b3698d7ab","Type":"ContainerStarted","Data":"a4d5362266ab2212469a899626f8f64302ff00821e197d500eae72bd69b2a1fc"}
Oct 30 20:38:14.730621 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:14.730581    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:14.730807 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:14.730672    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:14.730865 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:14.730813    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:14.730921 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:14.730874    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs podName:88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:16.730855745 +0000 UTC m=+6.021236666 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs") pod "network-metrics-daemon-n7qt5" (UID: "88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:14.731289 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:14.731269    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:14.731377 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:14.731327    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret podName:34e89d20-b285-4246-8184-9fe736a2c6fb nodeName:}" failed. No retries permitted until 2026-10-30 20:38:16.731311995 +0000 UTC m=+6.021692917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret") pod "global-pull-secret-syncer-jk8sp" (UID: "34e89d20-b285-4246-8184-9fe736a2c6fb") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:14.831278 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:14.831242    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvkf4\" (UniqueName: \"kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4\") pod \"network-check-target-qwmdw\" (UID: \"cf3347a5-26a7-4708-abb3-e3a39308f782\") " pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:14.831458 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:14.831441    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:14.831526 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:14.831468    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:14.831526 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:14.831481    2566 projected.go:196] Error preparing data for projected volume kube-api-access-dvkf4 for pod openshift-network-diagnostics/network-check-target-qwmdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:14.831637 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:14.831544    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4 podName:cf3347a5-26a7-4708-abb3-e3a39308f782 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:16.831523669 +0000 UTC m=+6.121904593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dvkf4" (UniqueName: "kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4") pod "network-check-target-qwmdw" (UID: "cf3347a5-26a7-4708-abb3-e3a39308f782") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:15.170236 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:15.169554    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:15.170236 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:15.169693    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7qt5" podUID="88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c"
Oct 30 20:38:15.170236 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:15.169554    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:15.170236 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:15.170134    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwmdw" podUID="cf3347a5-26a7-4708-abb3-e3a39308f782"
Oct 30 20:38:15.170673 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:15.170312    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:15.170673 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:15.170411    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8sp" podUID="34e89d20-b285-4246-8184-9fe736a2c6fb"
Oct 30 20:38:15.216254 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:15.216178    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:33:13 +0000 UTC" deadline="2028-05-13 04:13:29.794546261 +0000 UTC"
Oct 30 20:38:15.216254 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:15.216223    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13447h35m14.578327647s"
Oct 30 20:38:15.340159 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:15.340086    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal" event={"ID":"289e7d851e39af0854a82e99a8d41138","Type":"ContainerStarted","Data":"014b953cb3c4cd27568fb164dbfb65a4f514459e3b6ff132e85635a2505456db"}
Oct 30 20:38:16.352593 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:16.352118    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal" event={"ID":"5f4a5d3da19d20e6931f18f86a441dd3","Type":"ContainerStarted","Data":"a69acb1c6b066ac35aa9dfd83a1968d768da97fea8e880d9574284bc1ff7a454"}
Oct 30 20:38:16.373739 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:16.373670    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal" podStartSLOduration=3.373651547 podStartE2EDuration="3.373651547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:15.360100603 +0000 UTC m=+4.650481548" watchObservedRunningTime="2026-10-30 20:38:16.373651547 +0000 UTC m=+5.664032478"
Oct 30 20:38:16.748751 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:16.748455    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:16.748751 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:16.748530    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:16.748751 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:16.748681    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:16.748751 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:16.748746    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret podName:34e89d20-b285-4246-8184-9fe736a2c6fb nodeName:}" failed. No retries permitted until 2026-10-30 20:38:20.748726733 +0000 UTC m=+10.039107647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret") pod "global-pull-secret-syncer-jk8sp" (UID: "34e89d20-b285-4246-8184-9fe736a2c6fb") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:16.749157 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:16.749136    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:16.749226 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:16.749205    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs podName:88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:20.749188969 +0000 UTC m=+10.039569878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs") pod "network-metrics-daemon-n7qt5" (UID: "88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:16.849215 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:16.849179    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvkf4\" (UniqueName: \"kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4\") pod \"network-check-target-qwmdw\" (UID: \"cf3347a5-26a7-4708-abb3-e3a39308f782\") " pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:16.849399 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:16.849379    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:16.849492 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:16.849421    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:16.849492 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:16.849435    2566 projected.go:196] Error preparing data for projected volume kube-api-access-dvkf4 for pod openshift-network-diagnostics/network-check-target-qwmdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:16.849603 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:16.849501    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4 podName:cf3347a5-26a7-4708-abb3-e3a39308f782 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:20.849481565 +0000 UTC m=+10.139862473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dvkf4" (UniqueName: "kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4") pod "network-check-target-qwmdw" (UID: "cf3347a5-26a7-4708-abb3-e3a39308f782") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:17.169607 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:17.169576    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:17.169784 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:17.169708    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwmdw" podUID="cf3347a5-26a7-4708-abb3-e3a39308f782"
Oct 30 20:38:17.170141 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:17.170122    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:17.170253 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:17.170231    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7qt5" podUID="88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c"
Oct 30 20:38:17.170320 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:17.170303    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:17.170413 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:17.170394    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8sp" podUID="34e89d20-b285-4246-8184-9fe736a2c6fb"
Oct 30 20:38:17.363821 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:17.362899    2566 generic.go:356] "Generic (PLEG): container finished" podID="5f4a5d3da19d20e6931f18f86a441dd3" containerID="a69acb1c6b066ac35aa9dfd83a1968d768da97fea8e880d9574284bc1ff7a454" exitCode=0
Oct 30 20:38:17.363821 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:17.362999    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal" event={"ID":"5f4a5d3da19d20e6931f18f86a441dd3","Type":"ContainerDied","Data":"a69acb1c6b066ac35aa9dfd83a1968d768da97fea8e880d9574284bc1ff7a454"}
Oct 30 20:38:17.363821 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:17.363049    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal" event={"ID":"5f4a5d3da19d20e6931f18f86a441dd3","Type":"ContainerStarted","Data":"b4483e4fab513b0bb6917a97630301a9bc5f541638ca60575dac8189c7dc73db"}
Oct 30 20:38:17.367432 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:17.366772    2566 generic.go:356] "Generic (PLEG): container finished" podID="f7716064-3190-400e-be69-91ee32a14749" containerID="14de3e680f846dd7be1b425e3a12ac3ab033f8419036bdc3dc35713676a4b6ae" exitCode=0
Oct 30 20:38:17.367432 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:17.366817    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rs9rh" event={"ID":"f7716064-3190-400e-be69-91ee32a14749","Type":"ContainerDied","Data":"14de3e680f846dd7be1b425e3a12ac3ab033f8419036bdc3dc35713676a4b6ae"}
Oct 30 20:38:17.388193 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:17.388137    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal" podStartSLOduration=4.388118754 podStartE2EDuration="4.388118754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:17.387443246 +0000 UTC m=+6.677824177" watchObservedRunningTime="2026-10-30 20:38:17.388118754 +0000 UTC m=+6.678499687"
Oct 30 20:38:18.373220 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:18.373127    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7wl8g" event={"ID":"c9a4a383-c9b9-4475-b22e-d336d1a35422","Type":"ContainerStarted","Data":"908ade198bbf343c1a56ca569d3e56b08de7232b57d29fd3a3ab62e110db38d6"}
Oct 30 20:38:19.170671 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:19.169744    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:19.170671 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:19.169889    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7qt5" podUID="88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c"
Oct 30 20:38:19.170671 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:19.170301    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:19.170671 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:19.170405    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8sp" podUID="34e89d20-b285-4246-8184-9fe736a2c6fb"
Oct 30 20:38:19.170671 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:19.170493    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:19.170671 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:19.170569    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwmdw" podUID="cf3347a5-26a7-4708-abb3-e3a39308f782"
Oct 30 20:38:19.381332 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:19.381292    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-778mq" event={"ID":"f0f30507-57cb-4145-bd0c-f44b3698d7ab","Type":"ContainerStarted","Data":"82d8679543f5ddbb26a669b298746ac181585733f77f0dc8d00e522220ccf481"}
Oct 30 20:38:19.400540 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:19.399962    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7wl8g" podStartSLOduration=4.367078758 podStartE2EDuration="8.399948091s" totalImagesPullingTime="4.032869333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:18.393193987 +0000 UTC m=+7.683574917" watchObservedRunningTime="2026-10-30 20:38:19.399948091 +0000 UTC m=+8.690329021"
Oct 30 20:38:20.387823 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:20.387581    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5" event={"ID":"34f5534a-5450-43a0-8d78-bc7e362bcfa9","Type":"ContainerStarted","Data":"63c2eaa39221ae810da06a48e5f46e935c0fbe4dba4172f88d89c98706338b09"}
Oct 30 20:38:20.782151 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:20.782072    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:20.782151 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:20.782129    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:20.782388 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:20.782282    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:20.782388 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:20.782327    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret podName:34e89d20-b285-4246-8184-9fe736a2c6fb nodeName:}" failed. No retries permitted until 2026-10-30 20:38:28.782315251 +0000 UTC m=+18.072696156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret") pod "global-pull-secret-syncer-jk8sp" (UID: "34e89d20-b285-4246-8184-9fe736a2c6fb") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:20.782764 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:20.782729    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:20.782861 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:20.782778    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs podName:88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:28.782766313 +0000 UTC m=+18.073147221 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs") pod "network-metrics-daemon-n7qt5" (UID: "88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:20.882920 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:20.882882    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvkf4\" (UniqueName: \"kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4\") pod \"network-check-target-qwmdw\" (UID: \"cf3347a5-26a7-4708-abb3-e3a39308f782\") " pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:20.883237 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:20.883212    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:20.883341 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:20.883244    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:20.883341 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:20.883258    2566 projected.go:196] Error preparing data for projected volume kube-api-access-dvkf4 for pod openshift-network-diagnostics/network-check-target-qwmdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:20.883482 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:20.883445    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4 podName:cf3347a5-26a7-4708-abb3-e3a39308f782 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:28.883350459 +0000 UTC m=+18.173731364 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dvkf4" (UniqueName: "kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4") pod "network-check-target-qwmdw" (UID: "cf3347a5-26a7-4708-abb3-e3a39308f782") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:21.170596 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:21.170519    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:21.170732 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:21.170653    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7qt5" podUID="88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c"
Oct 30 20:38:21.171045 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:21.171025    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:21.171171 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:21.171118    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8sp" podUID="34e89d20-b285-4246-8184-9fe736a2c6fb"
Oct 30 20:38:21.171171 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:21.171165    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:21.171267 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:21.171231    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwmdw" podUID="cf3347a5-26a7-4708-abb3-e3a39308f782"
Oct 30 20:38:21.496695 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:21.496654    2566 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 20:38:22.172903 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:22.172566    2566 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T20:38:21.496691205Z","UUID":"3ba3bed4-57e1-4e53-b82e-1c14b80d518a","Handler":null,"Name":"","Endpoint":""}
Oct 30 20:38:22.174669 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:22.174317    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 20:38:22.174669 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:22.174346    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 20:38:22.363125 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:22.363097    2566 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7wl8g"
Oct 30 20:38:22.363745 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:22.363724    2566 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7wl8g"
Oct 30 20:38:22.383329 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:22.382922    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-778mq" podStartSLOduration=4.970807458 podStartE2EDuration="10.382910685s" totalImagesPullingTime="5.412103227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:19.400477856 +0000 UTC m=+8.690858788" watchObservedRunningTime="2026-10-30 20:38:22.382910685 +0000 UTC m=+11.673291669"
Oct 30 20:38:22.396415 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:22.396384    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8g6wj" event={"ID":"571e6927-684b-4d97-b9ab-4d2581d5235a","Type":"ContainerStarted","Data":"aa6ea55c0b413a57757b722aab098a2648f68c22e99fcaab4ab7c1958c021319"}
Oct 30 20:38:22.398726 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:22.398696    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rt5dq" event={"ID":"87b38c08-ae1d-4961-bd80-f0198dec4a22","Type":"ContainerStarted","Data":"b625542ac524d72ef6ec9f02b1fe699a11940d674b093a615dc24e2b83e8f6b3"}
Oct 30 20:38:22.401289 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:22.401211    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5" event={"ID":"34f5534a-5450-43a0-8d78-bc7e362bcfa9","Type":"ContainerStarted","Data":"b192e3067875cf51ad8e72a50b91ad0f200d91cc6dd48243c5aa0f41e0bab791"}
Oct 30 20:38:22.404775 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:22.403806    2566 generic.go:356] "Generic (PLEG): container finished" podID="f7716064-3190-400e-be69-91ee32a14749" containerID="98d5f3ff536585f5cb6f05eddb68d3dc9f14b3191dfe8c34a8d215cf5f6d1941" exitCode=0
Oct 30 20:38:22.404775 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:22.404716    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rs9rh" event={"ID":"f7716064-3190-400e-be69-91ee32a14749","Type":"ContainerDied","Data":"98d5f3ff536585f5cb6f05eddb68d3dc9f14b3191dfe8c34a8d215cf5f6d1941"}
Oct 30 20:38:22.441171 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:22.441129    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-8g6wj" podStartSLOduration=1.91269775 podStartE2EDuration="10.441116927s" totalImagesPullingTime="8.528419177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:22.415233469 +0000 UTC m=+11.705614396" watchObservedRunningTime="2026-10-30 20:38:22.441116927 +0000 UTC m=+11.731497883"
Oct 30 20:38:22.459691 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:22.459643    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-rt5dq" podStartSLOduration=2.401291741 podStartE2EDuration="10.45962861s" totalImagesPullingTime="8.058336869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:22.458922791 +0000 UTC m=+11.749303714" watchObservedRunningTime="2026-10-30 20:38:22.45962861 +0000 UTC m=+11.750009537"
Oct 30 20:38:23.168334 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:23.168107    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:23.168813 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:23.168452    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwmdw" podUID="cf3347a5-26a7-4708-abb3-e3a39308f782"
Oct 30 20:38:23.168813 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:23.168783    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:23.168934 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:23.168870    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7qt5" podUID="88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c"
Oct 30 20:38:23.169013 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:23.168996    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:23.169096 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:23.169080    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8sp" podUID="34e89d20-b285-4246-8184-9fe736a2c6fb"
Oct 30 20:38:23.408572 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:23.408472    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5" event={"ID":"34f5534a-5450-43a0-8d78-bc7e362bcfa9","Type":"ContainerStarted","Data":"93c538df95104c1a4b7207fe019c811274cc1ee60a78eb989f8e27c21bed385d"}
Oct 30 20:38:23.411599 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:23.411572    2566 generic.go:356] "Generic (PLEG): container finished" podID="f7716064-3190-400e-be69-91ee32a14749" containerID="e3cde09f55cdab039519aa806f4a905be85ca760a89813921d4679dca64395e3" exitCode=0
Oct 30 20:38:23.411820 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:23.411708    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rs9rh" event={"ID":"f7716064-3190-400e-be69-91ee32a14749","Type":"ContainerDied","Data":"e3cde09f55cdab039519aa806f4a905be85ca760a89813921d4679dca64395e3"}
Oct 30 20:38:23.416874 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:23.416844    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xkzc8" event={"ID":"06028e29-e135-48d5-aa5d-2c625009150d","Type":"ContainerStarted","Data":"fb0ea56008a6bbe68e17900704905a2c63eca8932e39ef76d83771bd7cb72aab"}
Oct 30 20:38:23.436980 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:23.436938    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5" podStartSLOduration=2.763321506 podStartE2EDuration="11.436925563s" totalImagesPullingTime="8.673604057s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:23.436100145 +0000 UTC m=+12.726481075" watchObservedRunningTime="2026-10-30 20:38:23.436925563 +0000 UTC m=+12.727306489"
Oct 30 20:38:23.477535 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:23.477496    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xkzc8" podStartSLOduration=3.093974724 podStartE2EDuration="11.477483919s" totalImagesPullingTime="8.383509195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:23.476761115 +0000 UTC m=+12.767142041" watchObservedRunningTime="2026-10-30 20:38:23.477483919 +0000 UTC m=+12.767864846"
Oct 30 20:38:24.420411 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:24.420354    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rs9rh" event={"ID":"f7716064-3190-400e-be69-91ee32a14749","Type":"ContainerStarted","Data":"9df2b171391a21e662e5fc0aa22d9738f82aa82a50b419eb6ca056e7a6f8a13a"}
Oct 30 20:38:24.421958 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:24.421931    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kbbkm" event={"ID":"b502ddfa-b655-45b6-9b0f-e936f85a0fcb","Type":"ContainerStarted","Data":"2b762b1a7bb2b9f915d2212ecda33c868240e5161451d8c8c373815ffcf3fdf9"}
Oct 30 20:38:24.469226 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:24.469184    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kbbkm" podStartSLOduration=2.7362239219999998 podStartE2EDuration="13.469170469s" totalImagesPullingTime="10.732946547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:24.469129688 +0000 UTC m=+13.759510615" watchObservedRunningTime="2026-10-30 20:38:24.469170469 +0000 UTC m=+13.759551393"
Oct 30 20:38:25.167322 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:25.167290    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:25.167490 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:25.167290    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:25.167490 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:25.167441    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7qt5" podUID="88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c"
Oct 30 20:38:25.167597 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:25.167539    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwmdw" podUID="cf3347a5-26a7-4708-abb3-e3a39308f782"
Oct 30 20:38:25.167630 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:25.167610    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:25.167698 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:25.167681    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8sp" podUID="34e89d20-b285-4246-8184-9fe736a2c6fb"
Oct 30 20:38:25.427191 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:25.427112    2566 generic.go:356] "Generic (PLEG): container finished" podID="f7716064-3190-400e-be69-91ee32a14749" containerID="9df2b171391a21e662e5fc0aa22d9738f82aa82a50b419eb6ca056e7a6f8a13a" exitCode=0
Oct 30 20:38:25.427746 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:25.427205    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rs9rh" event={"ID":"f7716064-3190-400e-be69-91ee32a14749","Type":"ContainerDied","Data":"9df2b171391a21e662e5fc0aa22d9738f82aa82a50b419eb6ca056e7a6f8a13a"}
Oct 30 20:38:27.168040 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:27.168007    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:27.168810 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:27.168118    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8sp" podUID="34e89d20-b285-4246-8184-9fe736a2c6fb"
Oct 30 20:38:27.168810 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:27.168021    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:27.168810 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:27.168175    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:27.168810 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:27.168269    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwmdw" podUID="cf3347a5-26a7-4708-abb3-e3a39308f782"
Oct 30 20:38:27.168810 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:27.168356    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7qt5" podUID="88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c"
Oct 30 20:38:28.434692 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:28.434530    2566 generic.go:356] "Generic (PLEG): container finished" podID="f7716064-3190-400e-be69-91ee32a14749" containerID="fc7bd1367178f55bd3ea9f9ab4c0f5d08536c024b39bcd9065844e7f2c0f2b94" exitCode=0
Oct 30 20:38:28.435043 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:28.434608    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rs9rh" event={"ID":"f7716064-3190-400e-be69-91ee32a14749","Type":"ContainerDied","Data":"fc7bd1367178f55bd3ea9f9ab4c0f5d08536c024b39bcd9065844e7f2c0f2b94"}
Oct 30 20:38:28.844924 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:28.844798    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:28.845014 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:28.844938    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:28.845014 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:28.844954    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:28.845014 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:28.844981    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs podName:88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:44.844968648 +0000 UTC m=+34.135349557 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs") pod "network-metrics-daemon-n7qt5" (UID: "88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:28.845113 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:28.845028    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:28.845113 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:28.845068    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret podName:34e89d20-b285-4246-8184-9fe736a2c6fb nodeName:}" failed. No retries permitted until 2026-10-30 20:38:44.845056706 +0000 UTC m=+34.135437624 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret") pod "global-pull-secret-syncer-jk8sp" (UID: "34e89d20-b285-4246-8184-9fe736a2c6fb") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:28.945896 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:28.945833    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvkf4\" (UniqueName: \"kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4\") pod \"network-check-target-qwmdw\" (UID: \"cf3347a5-26a7-4708-abb3-e3a39308f782\") " pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:28.945989 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:28.945975    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:28.946021 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:28.945994    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:28.946021 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:28.946003    2566 projected.go:196] Error preparing data for projected volume kube-api-access-dvkf4 for pod openshift-network-diagnostics/network-check-target-qwmdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:28.946084 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:28.946043    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4 podName:cf3347a5-26a7-4708-abb3-e3a39308f782 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:44.946030572 +0000 UTC m=+34.236411493 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dvkf4" (UniqueName: "kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4") pod "network-check-target-qwmdw" (UID: "cf3347a5-26a7-4708-abb3-e3a39308f782") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:29.167746 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:29.167720    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:29.167865 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:29.167720    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:29.167865 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:29.167824    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwmdw" podUID="cf3347a5-26a7-4708-abb3-e3a39308f782"
Oct 30 20:38:29.167959 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:29.167864    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:29.167959 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:29.167939    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7qt5" podUID="88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c"
Oct 30 20:38:29.168070 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:29.168005    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8sp" podUID="34e89d20-b285-4246-8184-9fe736a2c6fb"
Oct 30 20:38:29.355414 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:29.355391    2566 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7wl8g"
Oct 30 20:38:29.355530 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:29.355468    2566 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:38:29.355967 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:29.355951    2566 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7wl8g"
Oct 30 20:38:29.439477 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:29.439458    2566 generic.go:356] "Generic (PLEG): container finished" podID="f7716064-3190-400e-be69-91ee32a14749" containerID="743a4d3d695e0d657779cd3d02e8e57d8626f70dab1e6e726c2354faca890eac" exitCode=0
Oct 30 20:38:29.439847 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:29.439529    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rs9rh" event={"ID":"f7716064-3190-400e-be69-91ee32a14749","Type":"ContainerDied","Data":"743a4d3d695e0d657779cd3d02e8e57d8626f70dab1e6e726c2354faca890eac"}
Oct 30 20:38:29.442489 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:29.442474    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx" event={"ID":"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0","Type":"ContainerStarted","Data":"10075f187915d4e20d230a11770cb56570083879c6b0697f05156267335ba136"}
Oct 30 20:38:29.442548 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:29.442527    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx" event={"ID":"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0","Type":"ContainerStarted","Data":"976eeffb0f962751fdc9803bc485e6d90bc4c2413b30ff955dba5636b67e8cb2"}
Oct 30 20:38:29.442580 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:29.442563    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx" event={"ID":"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0","Type":"ContainerStarted","Data":"3b647cd7345fffa4722a06129c26d1d5c3945cdee96edddbe99588f0fc0f3654"}
Oct 30 20:38:29.442619 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:29.442591    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx" event={"ID":"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0","Type":"ContainerStarted","Data":"90374aac407fa08ac151ed6700d1988b37f192291b3514b8572c3fdd899d362e"}
Oct 30 20:38:29.442650 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:29.442617    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx" event={"ID":"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0","Type":"ContainerStarted","Data":"d7f5615c2207896f39417fb6075533e6584789aa9837080b434f468091010c93"}
Oct 30 20:38:29.442678 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:29.442649    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx" event={"ID":"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0","Type":"ContainerStarted","Data":"de3f025dfd930713ace25fe2ba8f9715a1bb0fbd23dbf3f050efd30dea7b486c"}
Oct 30 20:38:30.446725 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:30.446702    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rs9rh" event={"ID":"f7716064-3190-400e-be69-91ee32a14749","Type":"ContainerStarted","Data":"0f9c37252cc3c9a5496d5776fc966d55441b0c81e11dacbb44a012eaef23be73"}
Oct 30 20:38:30.475420 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:30.475383    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rs9rh" podStartSLOduration=7.252154461 podStartE2EDuration="18.475354441s" totalImagesPullingTime="11.22319998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:30.474832189 +0000 UTC m=+19.765213114" watchObservedRunningTime="2026-10-30 20:38:30.475354441 +0000 UTC m=+19.765735367"
Oct 30 20:38:31.168235 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:31.168201    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:31.168343 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:31.168291    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwmdw" podUID="cf3347a5-26a7-4708-abb3-e3a39308f782"
Oct 30 20:38:31.168418 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:31.168387    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:31.168477 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:31.168414    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:31.168477 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:31.168469    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7qt5" podUID="88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c"
Oct 30 20:38:31.168606 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:31.168522    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8sp" podUID="34e89d20-b285-4246-8184-9fe736a2c6fb"
Oct 30 20:38:31.450890 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:31.450868    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx" event={"ID":"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0","Type":"ContainerStarted","Data":"dd12857982fd27f67bedffa0ddb31ea2f6c42c823aa73283f80458f7908a81d3"}
Oct 30 20:38:33.167325 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:33.167290    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:33.167325 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:33.167304    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:33.168054 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:33.167427    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7qt5" podUID="88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c"
Oct 30 20:38:33.168054 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:33.167477    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwmdw" podUID="cf3347a5-26a7-4708-abb3-e3a39308f782"
Oct 30 20:38:33.168054 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:33.167496    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:33.168054 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:33.167548    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8sp" podUID="34e89d20-b285-4246-8184-9fe736a2c6fb"
Oct 30 20:38:33.458150 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:33.458122    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx" event={"ID":"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0","Type":"ContainerStarted","Data":"faaa186c3b2ded0b100f153020dd13ebb23f611707318f24bfe8518b43180dca"}
Oct 30 20:38:33.458462 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:33.458437    2566 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:33.473964 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:33.473945    2566 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:33.494151 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:33.494113    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx" podStartSLOduration=6.384059004 podStartE2EDuration="21.494102483s" totalImagesPullingTime="15.110043479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:33.4934919 +0000 UTC m=+22.783872825" watchObservedRunningTime="2026-10-30 20:38:33.494102483 +0000 UTC m=+22.784483409"
Oct 30 20:38:34.460619 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:34.460574    2566 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:38:34.461114 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:34.461027    2566 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:34.475197 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:34.475178    2566 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:34.765918 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:34.765862    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jk8sp"]
Oct 30 20:38:34.766029 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:34.765951    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:34.766060 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:34.766023    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8sp" podUID="34e89d20-b285-4246-8184-9fe736a2c6fb"
Oct 30 20:38:34.768476 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:34.768452    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qwmdw"]
Oct 30 20:38:34.768628 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:34.768536    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:34.768706 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:34.768658    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwmdw" podUID="cf3347a5-26a7-4708-abb3-e3a39308f782"
Oct 30 20:38:34.771573 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:34.771549    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n7qt5"]
Oct 30 20:38:34.771671 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:34.771650    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:34.771744 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:34.771729    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7qt5" podUID="88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c"
Oct 30 20:38:35.462701 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:35.462676    2566 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:38:36.167483 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:36.167460    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:36.167591 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:36.167491    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:36.167591 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:36.167552    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8sp" podUID="34e89d20-b285-4246-8184-9fe736a2c6fb"
Oct 30 20:38:36.167698 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:36.167633    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwmdw" podUID="cf3347a5-26a7-4708-abb3-e3a39308f782"
Oct 30 20:38:36.464225 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:36.464179    2566 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:38:37.167523 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:37.167502    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:37.167649 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:37.167627    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7qt5" podUID="88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c"
Oct 30 20:38:37.561906 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:37.561826    2566 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:38.168086 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:38.168062    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:38.168297 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:38.168170    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:38.168297 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:38.168172    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwmdw" podUID="cf3347a5-26a7-4708-abb3-e3a39308f782"
Oct 30 20:38:38.168297 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:38.168240    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8sp" podUID="34e89d20-b285-4246-8184-9fe736a2c6fb"
Oct 30 20:38:39.167417 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:39.167388    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:39.167864 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:39.167484    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7qt5" podUID="88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c"
Oct 30 20:38:40.168106 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:40.168074    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:40.168485 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:40.168074    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:40.168485 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:40.168185    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwmdw" podUID="cf3347a5-26a7-4708-abb3-e3a39308f782"
Oct 30 20:38:40.168485 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:40.168245    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk8sp" podUID="34e89d20-b285-4246-8184-9fe736a2c6fb"
Oct 30 20:38:41.169049 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.168976    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:41.169484 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.169118    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7qt5" podUID="88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c"
Oct 30 20:38:41.394027 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.394006    2566 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeReady"
Oct 30 20:38:41.394155 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.394103    2566 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 20:38:41.432783 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.432733    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sbz2m"]
Oct 30 20:38:41.438137 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.438117    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-5rf4c"]
Oct 30 20:38:41.438913 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.438339    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-sbz2m"
Oct 30 20:38:41.442914 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.442894    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-cd525"]
Oct 30 20:38:41.443024 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.443006    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-5rf4c"
Oct 30 20:38:41.444966 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.444947    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"]
Oct 30 20:38:41.445100 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.445082    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-cd525"
Oct 30 20:38:41.446865 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.446850    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"]
Oct 30 20:38:41.446974 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.446958    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:41.447457 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.447436    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 20:38:41.449045 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.449025    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 20:38:41.457856 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.456654    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 20:38:41.459651 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.459629    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"]
Oct 30 20:38:41.459859 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.459845    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:41.465299 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.465167    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-sxgrn"]
Oct 30 20:38:41.467201 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.466861    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"
Oct 30 20:38:41.471377 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.469881    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"]
Oct 30 20:38:41.471377 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.470091    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.473931 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.473911    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-fx72n"]
Oct 30 20:38:41.475521 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.475464    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"
Oct 30 20:38:41.480641 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.480619    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:41.481142 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.481030    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"]
Oct 30 20:38:41.485209 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.485191    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79c6d8c76d-pvcm5"]
Oct 30 20:38:41.485315 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.485301    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:41.488596 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.488577    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6fcdccbdf7-r26s9"]
Oct 30 20:38:41.488693 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.488679    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.491630 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.491611    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sbz2m"]
Oct 30 20:38:41.491720 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.491639    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qthmt"]
Oct 30 20:38:41.491783 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.491728    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.494820 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.494799    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7fc784755f-fpdq5"]
Oct 30 20:38:41.494986 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.494959    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qthmt"
Oct 30 20:38:41.499137 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.498719    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-h5lvt"]
Oct 30 20:38:41.499137 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.498788    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:41.506146 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.506124    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-5rf4c"]
Oct 30 20:38:41.506237 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.506161    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"]
Oct 30 20:38:41.506237 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.506183    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-sxgrn"]
Oct 30 20:38:41.506237 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.506206    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gxp9z"]
Oct 30 20:38:41.506396 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.506330    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h5lvt"
Oct 30 20:38:41.510939 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.510921    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xchc6"]
Oct 30 20:38:41.511098 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.511082    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gxp9z"
Oct 30 20:38:41.514237 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.514219    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"]
Oct 30 20:38:41.514326 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.514243    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"]
Oct 30 20:38:41.514326 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.514258    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-fx72n"]
Oct 30 20:38:41.514326 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.514307    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:41.514505 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.514340    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79c6d8c76d-pvcm5"]
Oct 30 20:38:41.514505 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.514353    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-cd525"]
Oct 30 20:38:41.514505 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.514386    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qthmt"]
Oct 30 20:38:41.514505 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.514399    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gxp9z"]
Oct 30 20:38:41.514505 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.514413    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xchc6"]
Oct 30 20:38:41.514505 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.514427    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"]
Oct 30 20:38:41.514505 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.514442    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7fc784755f-fpdq5"]
Oct 30 20:38:41.514505 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.514453    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-h5lvt"]
Oct 30 20:38:41.514505 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.514465    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"]
Oct 30 20:38:41.514505 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.514476    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fcdccbdf7-r26s9"]
Oct 30 20:38:41.539437 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.539418    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npfcb\" (UniqueName: \"kubernetes.io/projected/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-kube-api-access-npfcb\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4\" (UID: \"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"
Oct 30 20:38:41.539533 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.539473    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86386c5c-e63e-4a97-a58e-ee79814a585f-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:41.539533 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.539501    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2a12cab-f546-4344-8460-3f967e181eeb-serving-cert\") pod \"service-ca-operator-544d749c8c-frc7m\" (UID: \"b2a12cab-f546-4344-8460-3f967e181eeb\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"
Oct 30 20:38:41.539639 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.539561    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsx2t\" (UniqueName: \"kubernetes.io/projected/990e57a8-4ba2-43be-8108-2bcf3b8da004-kube-api-access-nsx2t\") pod \"kas-connection-checker-685895c7c9-5rf4c\" (UID: \"990e57a8-4ba2-43be-8108-2bcf3b8da004\") " pod="kube-system/kas-connection-checker-685895c7c9-5rf4c"
Oct 30 20:38:41.539639 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.539621    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-service-ca-bundle\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.539707 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.539664    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-serving-cert\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.539736 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.539728    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89r9b\" (UniqueName: \"kubernetes.io/projected/b2a12cab-f546-4344-8460-3f967e181eeb-kube-api-access-89r9b\") pod \"service-ca-operator-544d749c8c-frc7m\" (UID: \"b2a12cab-f546-4344-8460-3f967e181eeb\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"
Oct 30 20:38:41.539779 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.539749    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d262282-6f9c-4945-959d-81e9a9a12392-config\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:41.539779 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.539765    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d262282-6f9c-4945-959d-81e9a9a12392-trusted-ca\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:41.539841 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.539798    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rk9l\" (UniqueName: \"kubernetes.io/projected/9d262282-6f9c-4945-959d-81e9a9a12392-kube-api-access-6rk9l\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:41.539841 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.539820    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4\" (UID: \"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"
Oct 30 20:38:41.539900 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.539860    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll7j5\" (UniqueName: \"kubernetes.io/projected/f264b5d9-bc95-4e78-b399-43e8148c8768-kube-api-access-ll7j5\") pod \"kas-connection-checker-685895c7c9-cd525\" (UID: \"f264b5d9-bc95-4e78-b399-43e8148c8768\") " pod="kube-system/kas-connection-checker-685895c7c9-cd525"
Oct 30 20:38:41.539900 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.539894    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:41.539958 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.539911    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4\" (UID: \"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"
Oct 30 20:38:41.539958 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.539935    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzwtl\" (UniqueName: \"kubernetes.io/projected/e9ba6324-4a54-40b9-8c8c-b2dee0510797-kube-api-access-lzwtl\") pod \"kas-connection-checker-685895c7c9-sbz2m\" (UID: \"e9ba6324-4a54-40b9-8c8c-b2dee0510797\") " pod="kube-system/kas-connection-checker-685895c7c9-sbz2m"
Oct 30 20:38:41.540017 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.540009    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97prz\" (UniqueName: \"kubernetes.io/projected/86386c5c-e63e-4a97-a58e-ee79814a585f-kube-api-access-97prz\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:41.540051 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.540030    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.540093 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.540049    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2a12cab-f546-4344-8460-3f967e181eeb-config\") pod \"service-ca-operator-544d749c8c-frc7m\" (UID: \"b2a12cab-f546-4344-8460-3f967e181eeb\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"
Oct 30 20:38:41.540133 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.540112    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d262282-6f9c-4945-959d-81e9a9a12392-serving-cert\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:41.540170 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.540134    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-tmp\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.540170 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.540157    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-snapshots\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.540261 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.540175    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z9tp\" (UniqueName: \"kubernetes.io/projected/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-kube-api-access-4z9tp\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.554787 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.554764    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 20:38:41.554895 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.554826    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 20:38:41.554895 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.554837    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:41.554895 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.554831    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:41.554895 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.554873    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 20:38:41.554895 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.554893    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 20:38:41.555105 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.554912    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 20:38:41.555105 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.554916    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:41.555105 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.554939    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:41.555105 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.554948    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:41.555105 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.554965    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 20:38:41.555105 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.554940    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 20:38:41.555105 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.554980    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 20:38:41.555105 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.554981    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:41.555105 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.554987    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 20:38:41.555105 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.555044    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 20:38:41.555402 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.555155    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 20:38:41.555402 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.555227    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 20:38:41.555402 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.555264    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:41.555486 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.555438    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:41.556573 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.556553    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 20:38:41.556573 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.556565    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 20:38:41.556573 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.556557    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 20:38:41.556822 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.556594    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:41.556822 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.556676    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:38:41.556822 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.556717    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:41.556822 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.556746    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:38:41.558737 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.558718    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 20:38:41.563807 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.563790    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 20:38:41.565165 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.565144    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 20:38:41.565245 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.565174    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 20:38:41.565441 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.565418    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 20:38:41.565441 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.565419    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 20:38:41.565441 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.565417    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 20:38:41.565647 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.565565    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 20:38:41.566686 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.566671    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 20:38:41.566859 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.566844    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 20:38:41.566859 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.566854    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 20:38:41.566986 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.566851    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 20:38:41.566986 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.566860    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kxrnf\""
Oct 30 20:38:41.566986 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.566864    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gk5pt\""
Oct 30 20:38:41.566986 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.566977    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 20:38:41.567170 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.567015    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 20:38:41.567170 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.567018    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 20:38:41.568523 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.568474    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4f5dn\""
Oct 30 20:38:41.568888 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.568874    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-2jnwc\""
Oct 30 20:38:41.569141 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.569127    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 20:38:41.571999 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.571985    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 20:38:41.572741 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.572720    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 20:38:41.573431 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.573412    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 20:38:41.640566 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.640534    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rk9l\" (UniqueName: \"kubernetes.io/projected/9d262282-6f9c-4945-959d-81e9a9a12392-kube-api-access-6rk9l\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:41.640566 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.640567    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-image-registry-private-configuration\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.640723 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.640588    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:41.640723 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.640605    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzwtl\" (UniqueName: \"kubernetes.io/projected/e9ba6324-4a54-40b9-8c8c-b2dee0510797-kube-api-access-lzwtl\") pod \"kas-connection-checker-685895c7c9-sbz2m\" (UID: \"e9ba6324-4a54-40b9-8c8c-b2dee0510797\") " pod="kube-system/kas-connection-checker-685895c7c9-sbz2m"
Oct 30 20:38:41.640723 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.640628    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:41.640723 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.640669    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:41.640918 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.640743    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:41.640918 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.640783    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97prz\" (UniqueName: \"kubernetes.io/projected/86386c5c-e63e-4a97-a58e-ee79814a585f-kube-api-access-97prz\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:41.641016 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.640932    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls podName:86386c5c-e63e-4a97-a58e-ee79814a585f nodeName:}" failed. No retries permitted until 2026-10-30 20:38:42.140912596 +0000 UTC m=+31.431293506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-5pmqz" (UID: "86386c5c-e63e-4a97-a58e-ee79814a585f") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:41.641016 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.640956    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-default-certificate\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:41.641016 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.640983    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d204b46f-c6a4-440f-8078-ce647d423f59-config-volume\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:41.641173 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641059    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.641173 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641094    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-snapshots\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.641173 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641135    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-certificates\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.641173 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641162    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-registry-certificates\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.641385 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641189    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmxmn\" (UniqueName: \"kubernetes.io/projected/dda1e37e-2f98-46b0-8ad9-632d308a5744-kube-api-access-wmxmn\") pod \"network-check-source-6f78d59f99-h5lvt\" (UID: \"dda1e37e-2f98-46b0-8ad9-632d308a5744\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h5lvt"
Oct 30 20:38:41.641385 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641233    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-bound-sa-token\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.641385 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641304    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90198fcb-a25b-4437-965b-750ede2da138-ca-trust-extracted\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.641385 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641349    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:41.641526 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641399    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-stats-auth\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:41.641526 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641464    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:41.641526 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641507    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z9tp\" (UniqueName: \"kubernetes.io/projected/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-kube-api-access-4z9tp\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.641671 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641586    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsx2t\" (UniqueName: \"kubernetes.io/projected/990e57a8-4ba2-43be-8108-2bcf3b8da004-kube-api-access-nsx2t\") pod \"kas-connection-checker-685895c7c9-5rf4c\" (UID: \"990e57a8-4ba2-43be-8108-2bcf3b8da004\") " pod="kube-system/kas-connection-checker-685895c7c9-5rf4c"
Oct 30 20:38:41.641671 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641616    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-serving-cert\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.641671 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641640    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.641811 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641709    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2c88c202-657d-49fd-83af-da47476931a9-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:41.641811 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641752    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89r9b\" (UniqueName: \"kubernetes.io/projected/b2a12cab-f546-4344-8460-3f967e181eeb-kube-api-access-89r9b\") pod \"service-ca-operator-544d749c8c-frc7m\" (UID: \"b2a12cab-f546-4344-8460-3f967e181eeb\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"
Oct 30 20:38:41.641811 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641766    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-snapshots\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.641811 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641779    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4\" (UID: \"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"
Oct 30 20:38:41.641811 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641806    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6xh6\" (UniqueName: \"kubernetes.io/projected/7e9d8fb4-c43e-4973-b67b-7cca18f00408-kube-api-access-v6xh6\") pod \"volume-data-source-validator-58c9f5f46d-qthmt\" (UID: \"7e9d8fb4-c43e-4973-b67b-7cca18f00408\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qthmt"
Oct 30 20:38:41.642014 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641828    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztctx\" (UniqueName: \"kubernetes.io/projected/86ced41b-f67d-4a69-9c48-81be43c75698-kube-api-access-ztctx\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:41.642014 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641855    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d262282-6f9c-4945-959d-81e9a9a12392-config\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:41.642014 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641882    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d262282-6f9c-4945-959d-81e9a9a12392-trusted-ca\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:41.642014 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641908    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll7j5\" (UniqueName: \"kubernetes.io/projected/f264b5d9-bc95-4e78-b399-43e8148c8768-kube-api-access-ll7j5\") pod \"kas-connection-checker-685895c7c9-cd525\" (UID: \"f264b5d9-bc95-4e78-b399-43e8148c8768\") " pod="kube-system/kas-connection-checker-685895c7c9-cd525"
Oct 30 20:38:41.642014 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641935    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4\" (UID: \"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"
Oct 30 20:38:41.642014 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641948    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.642014 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.641952    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-bound-sa-token\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.642315 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.642077    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:41.642315 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.642173    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-ca-trust-extracted\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.642315 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.642209    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-installation-pull-secrets\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.642315 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.642290    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4\" (UID: \"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"
Oct 30 20:38:41.642508 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.642328    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2a12cab-f546-4344-8460-3f967e181eeb-config\") pod \"service-ca-operator-544d749c8c-frc7m\" (UID: \"b2a12cab-f546-4344-8460-3f967e181eeb\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"
Oct 30 20:38:41.642508 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.642453    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6xjn\" (UniqueName: \"kubernetes.io/projected/2d040316-e799-40d0-b5ee-2a4351ca99bd-kube-api-access-p6xjn\") pod \"ingress-canary-gxp9z\" (UID: \"2d040316-e799-40d0-b5ee-2a4351ca99bd\") " pod="openshift-ingress-canary/ingress-canary-gxp9z"
Oct 30 20:38:41.642508 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.642485    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d262282-6f9c-4945-959d-81e9a9a12392-config\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:41.642651 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.642558    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzclf\" (UniqueName: \"kubernetes.io/projected/d204b46f-c6a4-440f-8078-ce647d423f59-kube-api-access-nzclf\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:41.642651 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.642634    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d262282-6f9c-4945-959d-81e9a9a12392-serving-cert\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:41.642754 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.642654    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d262282-6f9c-4945-959d-81e9a9a12392-trusted-ca\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:41.642754 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.642679    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-tmp\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.642861 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.642797    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mjsj\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-kube-api-access-9mjsj\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.642861 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.642827    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.642966 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.642868    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6w9q\" (UniqueName: \"kubernetes.io/projected/75581bb4-9213-4894-ad60-5cbe03c4ff6c-kube-api-access-l6w9q\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:41.642966 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.642894    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npfcb\" (UniqueName: \"kubernetes.io/projected/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-kube-api-access-npfcb\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4\" (UID: \"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"
Oct 30 20:38:41.642966 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.642937    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2a12cab-f546-4344-8460-3f967e181eeb-config\") pod \"service-ca-operator-544d749c8c-frc7m\" (UID: \"b2a12cab-f546-4344-8460-3f967e181eeb\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"
Oct 30 20:38:41.642966 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.642953    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-trusted-ca\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.643216 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.643193    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-tmp\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.643326 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.643270    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86386c5c-e63e-4a97-a58e-ee79814a585f-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:41.643402 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.643328    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:41.643402 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.643356    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-image-registry-private-configuration\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.643505 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.643404    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-trusted-ca\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.643505 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.643433    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2a12cab-f546-4344-8460-3f967e181eeb-serving-cert\") pod \"service-ca-operator-544d749c8c-frc7m\" (UID: \"b2a12cab-f546-4344-8460-3f967e181eeb\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"
Oct 30 20:38:41.643505 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.643457    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l45ml\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-kube-api-access-l45ml\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.643505 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.643483    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-service-ca-bundle\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.643746 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.643507    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d040316-e799-40d0-b5ee-2a4351ca99bd-cert\") pod \"ingress-canary-gxp9z\" (UID: \"2d040316-e799-40d0-b5ee-2a4351ca99bd\") " pod="openshift-ingress-canary/ingress-canary-gxp9z"
Oct 30 20:38:41.643746 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.643542    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d204b46f-c6a4-440f-8078-ce647d423f59-tmp-dir\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:41.643746 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.643585    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-installation-pull-secrets\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.644052 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.644030    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86386c5c-e63e-4a97-a58e-ee79814a585f-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:41.644134 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.644071    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-service-ca-bundle\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.645532 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.645507    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4\" (UID: \"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"
Oct 30 20:38:41.645532 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.645516    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-serving-cert\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.645532 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.645529    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d262282-6f9c-4945-959d-81e9a9a12392-serving-cert\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:41.645752 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.645737    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2a12cab-f546-4344-8460-3f967e181eeb-serving-cert\") pod \"service-ca-operator-544d749c8c-frc7m\" (UID: \"b2a12cab-f546-4344-8460-3f967e181eeb\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"
Oct 30 20:38:41.653698 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.653671    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzwtl\" (UniqueName: \"kubernetes.io/projected/e9ba6324-4a54-40b9-8c8c-b2dee0510797-kube-api-access-lzwtl\") pod \"kas-connection-checker-685895c7c9-sbz2m\" (UID: \"e9ba6324-4a54-40b9-8c8c-b2dee0510797\") " pod="kube-system/kas-connection-checker-685895c7c9-sbz2m"
Oct 30 20:38:41.653859 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.653843    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z9tp\" (UniqueName: \"kubernetes.io/projected/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-kube-api-access-4z9tp\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.655088 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.655069    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89r9b\" (UniqueName: \"kubernetes.io/projected/b2a12cab-f546-4344-8460-3f967e181eeb-kube-api-access-89r9b\") pod \"service-ca-operator-544d749c8c-frc7m\" (UID: \"b2a12cab-f546-4344-8460-3f967e181eeb\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"
Oct 30 20:38:41.655197 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.655141    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsx2t\" (UniqueName: \"kubernetes.io/projected/990e57a8-4ba2-43be-8108-2bcf3b8da004-kube-api-access-nsx2t\") pod \"kas-connection-checker-685895c7c9-5rf4c\" (UID: \"990e57a8-4ba2-43be-8108-2bcf3b8da004\") " pod="kube-system/kas-connection-checker-685895c7c9-5rf4c"
Oct 30 20:38:41.656467 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.656451    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rk9l\" (UniqueName: \"kubernetes.io/projected/9d262282-6f9c-4945-959d-81e9a9a12392-kube-api-access-6rk9l\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:41.658337 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.658313    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npfcb\" (UniqueName: \"kubernetes.io/projected/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-kube-api-access-npfcb\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4\" (UID: \"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"
Oct 30 20:38:41.658643 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.658628    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll7j5\" (UniqueName: \"kubernetes.io/projected/f264b5d9-bc95-4e78-b399-43e8148c8768-kube-api-access-ll7j5\") pod \"kas-connection-checker-685895c7c9-cd525\" (UID: \"f264b5d9-bc95-4e78-b399-43e8148c8768\") " pod="kube-system/kas-connection-checker-685895c7c9-cd525"
Oct 30 20:38:41.664682 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.664655    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97prz\" (UniqueName: \"kubernetes.io/projected/86386c5c-e63e-4a97-a58e-ee79814a585f-kube-api-access-97prz\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:41.744187 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744115    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmxmn\" (UniqueName: \"kubernetes.io/projected/dda1e37e-2f98-46b0-8ad9-632d308a5744-kube-api-access-wmxmn\") pod \"network-check-source-6f78d59f99-h5lvt\" (UID: \"dda1e37e-2f98-46b0-8ad9-632d308a5744\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h5lvt"
Oct 30 20:38:41.744187 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744145    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-bound-sa-token\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.744187 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744163    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90198fcb-a25b-4437-965b-750ede2da138-ca-trust-extracted\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.744187 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744185    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:41.744472 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744209    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-stats-auth\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:41.744472 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744234    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:41.744472 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.744305    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:38:41.744472 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.744313    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:38:41.744472 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.744383    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert podName:2c88c202-657d-49fd-83af-da47476931a9 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:42.24434819 +0000 UTC m=+31.534729115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fx72n" (UID: "2c88c202-657d-49fd-83af-da47476931a9") : secret "networking-console-plugin-cert" not found
Oct 30 20:38:41.744472 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.744405    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls podName:75581bb4-9213-4894-ad60-5cbe03c4ff6c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:42.244394617 +0000 UTC m=+31.534775523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xpnhd" (UID: "75581bb4-9213-4894-ad60-5cbe03c4ff6c") : secret "samples-operator-tls" not found
Oct 30 20:38:41.744472 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744423    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.744472 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744454    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2c88c202-657d-49fd-83af-da47476931a9-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:41.744847 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744488    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6xh6\" (UniqueName: \"kubernetes.io/projected/7e9d8fb4-c43e-4973-b67b-7cca18f00408-kube-api-access-v6xh6\") pod \"volume-data-source-validator-58c9f5f46d-qthmt\" (UID: \"7e9d8fb4-c43e-4973-b67b-7cca18f00408\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qthmt"
Oct 30 20:38:41.744847 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744516    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztctx\" (UniqueName: \"kubernetes.io/projected/86ced41b-f67d-4a69-9c48-81be43c75698-kube-api-access-ztctx\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:41.744847 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.744520    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:41.744847 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744559    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-bound-sa-token\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.744847 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.744574    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fcdccbdf7-r26s9: secret "image-registry-tls" not found
Oct 30 20:38:41.744847 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744583    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:41.744847 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744593    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90198fcb-a25b-4437-965b-750ede2da138-ca-trust-extracted\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.744847 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744614    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-ca-trust-extracted\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.744847 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.744625    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls podName:04f91be3-79d3-4f15-a7ba-f2d0bb249e02 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:42.244608014 +0000 UTC m=+31.534988919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls") pod "image-registry-6fcdccbdf7-r26s9" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02") : secret "image-registry-tls" not found
Oct 30 20:38:41.744847 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744667    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-installation-pull-secrets\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.744847 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.744682    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:38:41.744847 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744708    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6xjn\" (UniqueName: \"kubernetes.io/projected/2d040316-e799-40d0-b5ee-2a4351ca99bd-kube-api-access-p6xjn\") pod \"ingress-canary-gxp9z\" (UID: \"2d040316-e799-40d0-b5ee-2a4351ca99bd\") " pod="openshift-ingress-canary/ingress-canary-gxp9z"
Oct 30 20:38:41.744847 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.744723    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls podName:d204b46f-c6a4-440f-8078-ce647d423f59 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:42.244708628 +0000 UTC m=+31.535089536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls") pod "dns-default-xchc6" (UID: "d204b46f-c6a4-440f-8078-ce647d423f59") : secret "dns-default-metrics-tls" not found
Oct 30 20:38:41.744847 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744753    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzclf\" (UniqueName: \"kubernetes.io/projected/d204b46f-c6a4-440f-8078-ce647d423f59-kube-api-access-nzclf\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:41.744847 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744789    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mjsj\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-kube-api-access-9mjsj\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.744847 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744813    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.745655 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744842    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6w9q\" (UniqueName: \"kubernetes.io/projected/75581bb4-9213-4894-ad60-5cbe03c4ff6c-kube-api-access-l6w9q\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:41.745655 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744890    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-trusted-ca\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.745655 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744923    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-ca-trust-extracted\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.745655 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744931    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:41.745655 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.744939    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:41.745655 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.744954    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79c6d8c76d-pvcm5: secret "image-registry-tls" not found
Oct 30 20:38:41.745655 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744957    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-image-registry-private-configuration\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.745655 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.744983    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-trusted-ca\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.745655 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.744990    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls podName:90198fcb-a25b-4437-965b-750ede2da138 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:42.244978015 +0000 UTC m=+31.535358920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls") pod "image-registry-79c6d8c76d-pvcm5" (UID: "90198fcb-a25b-4437-965b-750ede2da138") : secret "image-registry-tls" not found
Oct 30 20:38:41.745655 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.745028    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l45ml\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-kube-api-access-l45ml\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.745655 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.745057    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d040316-e799-40d0-b5ee-2a4351ca99bd-cert\") pod \"ingress-canary-gxp9z\" (UID: \"2d040316-e799-40d0-b5ee-2a4351ca99bd\") " pod="openshift-ingress-canary/ingress-canary-gxp9z"
Oct 30 20:38:41.745655 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.745106    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d204b46f-c6a4-440f-8078-ce647d423f59-tmp-dir\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:41.745655 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.745131    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-installation-pull-secrets\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.745655 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.745206    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-image-registry-private-configuration\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.745655 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.745253    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:41.745655 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.745278    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:41.746415 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.745306    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-default-certificate\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:41.746415 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.745329    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2c88c202-657d-49fd-83af-da47476931a9-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:41.746415 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.745335    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d204b46f-c6a4-440f-8078-ce647d423f59-config-volume\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:41.746415 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.745415    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-certificates\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.746415 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.745442    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-registry-certificates\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.746415 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.745717    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:41.746415 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.745822    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-trusted-ca\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.746415 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.745957    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-trusted-ca\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.746415 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.745990    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-registry-certificates\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.746415 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.746133    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle podName:86ced41b-f67d-4a69-9c48-81be43c75698 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:42.246119269 +0000 UTC m=+31.536500194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle") pod "router-default-7fc784755f-fpdq5" (UID: "86ced41b-f67d-4a69-9c48-81be43c75698") : configmap references non-existent config key: service-ca.crt
Oct 30 20:38:41.746415 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.746198    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:38:41.746415 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:41.746234    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs podName:86ced41b-f67d-4a69-9c48-81be43c75698 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:42.246222059 +0000 UTC m=+31.536602968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs") pod "router-default-7fc784755f-fpdq5" (UID: "86ced41b-f67d-4a69-9c48-81be43c75698") : secret "router-metrics-certs-default" not found
Oct 30 20:38:41.746415 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.746343    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d204b46f-c6a4-440f-8078-ce647d423f59-tmp-dir\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:41.747023 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.746730    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d204b46f-c6a4-440f-8078-ce647d423f59-config-volume\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:41.747023 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.746751    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-certificates\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.747815 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.747782    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-installation-pull-secrets\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.748094 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.748069    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-installation-pull-secrets\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.748301 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.748280    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-stats-auth\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:41.748461 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.748448    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d040316-e799-40d0-b5ee-2a4351ca99bd-cert\") pod \"ingress-canary-gxp9z\" (UID: \"2d040316-e799-40d0-b5ee-2a4351ca99bd\") " pod="openshift-ingress-canary/ingress-canary-gxp9z"
Oct 30 20:38:41.748729 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.748711    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-image-registry-private-configuration\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.749532 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.749508    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-image-registry-private-configuration\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.749599 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.749549    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-default-certificate\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:41.757061 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.757040    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-bound-sa-token\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.757241 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.757223    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmxmn\" (UniqueName: \"kubernetes.io/projected/dda1e37e-2f98-46b0-8ad9-632d308a5744-kube-api-access-wmxmn\") pod \"network-check-source-6f78d59f99-h5lvt\" (UID: \"dda1e37e-2f98-46b0-8ad9-632d308a5744\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h5lvt"
Oct 30 20:38:41.758276 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.758257    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mjsj\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-kube-api-access-9mjsj\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.758914 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.758894    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-sbz2m"
Oct 30 20:38:41.760718 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.760633    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-bound-sa-token\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:41.760828 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.760731    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6w9q\" (UniqueName: \"kubernetes.io/projected/75581bb4-9213-4894-ad60-5cbe03c4ff6c-kube-api-access-l6w9q\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:41.760828 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.760784    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l45ml\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-kube-api-access-l45ml\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:41.762522 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.762498    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6xjn\" (UniqueName: \"kubernetes.io/projected/2d040316-e799-40d0-b5ee-2a4351ca99bd-kube-api-access-p6xjn\") pod \"ingress-canary-gxp9z\" (UID: \"2d040316-e799-40d0-b5ee-2a4351ca99bd\") " pod="openshift-ingress-canary/ingress-canary-gxp9z"
Oct 30 20:38:41.762637 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.762616    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztctx\" (UniqueName: \"kubernetes.io/projected/86ced41b-f67d-4a69-9c48-81be43c75698-kube-api-access-ztctx\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:41.762816 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.762801    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzclf\" (UniqueName: \"kubernetes.io/projected/d204b46f-c6a4-440f-8078-ce647d423f59-kube-api-access-nzclf\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:41.762850 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.762820    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6xh6\" (UniqueName: \"kubernetes.io/projected/7e9d8fb4-c43e-4973-b67b-7cca18f00408-kube-api-access-v6xh6\") pod \"volume-data-source-validator-58c9f5f46d-qthmt\" (UID: \"7e9d8fb4-c43e-4973-b67b-7cca18f00408\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qthmt"
Oct 30 20:38:41.764672 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.764657    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-5rf4c"
Oct 30 20:38:41.770625 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.770601    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:41.775972 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.775956    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-cd525"
Oct 30 20:38:41.794793 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.794778    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:41.807260 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.807242    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"
Oct 30 20:38:41.811954 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.811938    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:41.818861 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.818822    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"
Oct 30 20:38:41.853676 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.851137    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qthmt"
Oct 30 20:38:41.865014 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.863068    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h5lvt"
Oct 30 20:38:41.870751 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:41.870724    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gxp9z"
Oct 30 20:38:42.037420 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.032041    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:42.083997 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.083972    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sbz2m"]
Oct 30 20:38:42.085344 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.085322    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-5rf4c"]
Oct 30 20:38:42.086341 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:42.086316    2566 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ba6324_4a54_40b9_8c8c_b2dee0510797.slice/crio-2a32c8d03f6550f6689eaac809b0765b6767c20be6db368aecd22b1c8a75b349 WatchSource:0}: Error finding container 2a32c8d03f6550f6689eaac809b0765b6767c20be6db368aecd22b1c8a75b349: Status 404 returned error can't find the container with id 2a32c8d03f6550f6689eaac809b0765b6767c20be6db368aecd22b1c8a75b349
Oct 30 20:38:42.087048 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:42.087027    2566 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990e57a8_4ba2_43be_8108_2bcf3b8da004.slice/crio-2303a31e05104c3a9c1f779c27193bde50b235185e1f698154305848ea8de0e2 WatchSource:0}: Error finding container 2303a31e05104c3a9c1f779c27193bde50b235185e1f698154305848ea8de0e2: Status 404 returned error can't find the container with id 2303a31e05104c3a9c1f779c27193bde50b235185e1f698154305848ea8de0e2
Oct 30 20:38:42.126975 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.126947    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"]
Oct 30 20:38:42.153288 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.153256    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:42.153507 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:42.153455    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:42.153636 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:42.153523    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls podName:86386c5c-e63e-4a97-a58e-ee79814a585f nodeName:}" failed. No retries permitted until 2026-10-30 20:38:43.153504795 +0000 UTC m=+32.443885702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-5pmqz" (UID: "86386c5c-e63e-4a97-a58e-ee79814a585f") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:42.167253 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.167232    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:42.167343 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.167262    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:42.175040 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.175019    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"]
Oct 30 20:38:42.182972 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:42.182943    2566 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a12cab_f546_4344_8460_3f967e181eeb.slice/crio-8e73ccc5c3c664c0cf1118b6ac6a9cbc9e35495e188726edc703d01c5396c456 WatchSource:0}: Error finding container 8e73ccc5c3c664c0cf1118b6ac6a9cbc9e35495e188726edc703d01c5396c456: Status 404 returned error can't find the container with id 8e73ccc5c3c664c0cf1118b6ac6a9cbc9e35495e188726edc703d01c5396c456
Oct 30 20:38:42.186407 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.186218    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"]
Oct 30 20:38:42.189917 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.189896    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-sxgrn"]
Oct 30 20:38:42.191131 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.191112    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-cd525"]
Oct 30 20:38:42.228414 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.228389    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-q55wr\""
Oct 30 20:38:42.228488 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.228436    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:38:42.228488 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.228451    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-r8zbf\""
Oct 30 20:38:42.233394 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.233373    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qthmt"]
Oct 30 20:38:42.238694 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.238005    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gxp9z"]
Oct 30 20:38:42.239706 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.239341    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-h5lvt"]
Oct 30 20:38:42.240914 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:42.240816    2566 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d040316_e799_40d0_b5ee_2a4351ca99bd.slice/crio-9ad382e3d5d01e9b5eb6c57ba0572504c123d93ef5326cebf97c9a16c629f8dc WatchSource:0}: Error finding container 9ad382e3d5d01e9b5eb6c57ba0572504c123d93ef5326cebf97c9a16c629f8dc: Status 404 returned error can't find the container with id 9ad382e3d5d01e9b5eb6c57ba0572504c123d93ef5326cebf97c9a16c629f8dc
Oct 30 20:38:42.241667 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:42.241639    2566 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda1e37e_2f98_46b0_8ad9_632d308a5744.slice/crio-17eb869a7aeffaa252c4ab447a6dbeb1fb3ee857526d91a15a89aedb81ba19d9 WatchSource:0}: Error finding container 17eb869a7aeffaa252c4ab447a6dbeb1fb3ee857526d91a15a89aedb81ba19d9: Status 404 returned error can't find the container with id 17eb869a7aeffaa252c4ab447a6dbeb1fb3ee857526d91a15a89aedb81ba19d9
Oct 30 20:38:42.253749 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.253700    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:42.253749 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.253732    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:42.253889 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.253780    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:42.253889 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.253825    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:42.253889 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:42.253842    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:38:42.253889 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.253869    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:42.253889 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:42.253891    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls podName:75581bb4-9213-4894-ad60-5cbe03c4ff6c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:43.253873459 +0000 UTC m=+32.544254377 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xpnhd" (UID: "75581bb4-9213-4894-ad60-5cbe03c4ff6c") : secret "samples-operator-tls" not found
Oct 30 20:38:42.254135 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:42.253940    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:42.254135 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:42.253951    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79c6d8c76d-pvcm5: secret "image-registry-tls" not found
Oct 30 20:38:42.254135 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:42.253983    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls podName:90198fcb-a25b-4437-965b-750ede2da138 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:43.253972531 +0000 UTC m=+32.544353451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls") pod "image-registry-79c6d8c76d-pvcm5" (UID: "90198fcb-a25b-4437-965b-750ede2da138") : secret "image-registry-tls" not found
Oct 30 20:38:42.254135 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.254014    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:42.254135 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:42.254036    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:42.254135 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:42.254047    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fcdccbdf7-r26s9: secret "image-registry-tls" not found
Oct 30 20:38:42.254135 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:42.254077    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls podName:04f91be3-79d3-4f15-a7ba-f2d0bb249e02 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:43.254067208 +0000 UTC m=+32.544448130 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls") pod "image-registry-6fcdccbdf7-r26s9" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02") : secret "image-registry-tls" not found
Oct 30 20:38:42.254135 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:42.254101    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:38:42.254135 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:42.254131    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs podName:86ced41b-f67d-4a69-9c48-81be43c75698 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:43.254121953 +0000 UTC m=+32.544502876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs") pod "router-default-7fc784755f-fpdq5" (UID: "86ced41b-f67d-4a69-9c48-81be43c75698") : secret "router-metrics-certs-default" not found
Oct 30 20:38:42.254135 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:42.254135    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:38:42.254627 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:42.254165    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert podName:2c88c202-657d-49fd-83af-da47476931a9 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:43.254155858 +0000 UTC m=+32.544536777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fx72n" (UID: "2c88c202-657d-49fd-83af-da47476931a9") : secret "networking-console-plugin-cert" not found
Oct 30 20:38:42.254627 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.254045    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:42.254627 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:42.254185    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:38:42.254627 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:42.254211    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls podName:d204b46f-c6a4-440f-8078-ce647d423f59 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:43.254202811 +0000 UTC m=+32.544583730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls") pod "dns-default-xchc6" (UID: "d204b46f-c6a4-440f-8078-ce647d423f59") : secret "dns-default-metrics-tls" not found
Oct 30 20:38:42.254627 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:42.254255    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle podName:86ced41b-f67d-4a69-9c48-81be43c75698 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:43.254245938 +0000 UTC m=+32.544626849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle") pod "router-default-7fc784755f-fpdq5" (UID: "86ced41b-f67d-4a69-9c48-81be43c75698") : configmap references non-existent config key: service-ca.crt
Oct 30 20:38:42.263832 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.263812    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:42.478143 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.478104    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:42.483217 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.483195    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4" event={"ID":"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c","Type":"ContainerStarted","Data":"8560913ce269f1d07e18c091452a0a2e14656f00203bf3280d76eaa3c6c6bf3b"}
Oct 30 20:38:42.484293 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.484272    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h5lvt" event={"ID":"dda1e37e-2f98-46b0-8ad9-632d308a5744","Type":"ContainerStarted","Data":"17eb869a7aeffaa252c4ab447a6dbeb1fb3ee857526d91a15a89aedb81ba19d9"}
Oct 30 20:38:42.485266 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.485248    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m" event={"ID":"b2a12cab-f546-4344-8460-3f967e181eeb","Type":"ContainerStarted","Data":"8e73ccc5c3c664c0cf1118b6ac6a9cbc9e35495e188726edc703d01c5396c456"}
Oct 30 20:38:42.486307 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.486287    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq" event={"ID":"9d262282-6f9c-4945-959d-81e9a9a12392","Type":"ContainerStarted","Data":"4a06cccd8363eb976ad80cdab3524fef2f280c144292e32dbb2a44e4460cf5a0"}
Oct 30 20:38:42.487485 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.487465    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gxp9z" event={"ID":"2d040316-e799-40d0-b5ee-2a4351ca99bd","Type":"ContainerStarted","Data":"9ad382e3d5d01e9b5eb6c57ba0572504c123d93ef5326cebf97c9a16c629f8dc"}
Oct 30 20:38:42.488854 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.488833    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-5rf4c" event={"ID":"990e57a8-4ba2-43be-8108-2bcf3b8da004","Type":"ContainerStarted","Data":"79c8668ba9c20c6c693ddda70d94e03f0fefece052a2d04ecaa2464ec1fe9e94"}
Oct 30 20:38:42.488936 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.488875    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-5rf4c" event={"ID":"990e57a8-4ba2-43be-8108-2bcf3b8da004","Type":"ContainerStarted","Data":"2303a31e05104c3a9c1f779c27193bde50b235185e1f698154305848ea8de0e2"}
Oct 30 20:38:42.490196 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.490171    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-cd525" event={"ID":"f264b5d9-bc95-4e78-b399-43e8148c8768","Type":"ContainerStarted","Data":"8cc76c5457292e2b2a0ae032bd401138ef3c1b97e54dd2cba8bbed8bfc49944b"}
Oct 30 20:38:42.490295 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.490207    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-cd525" event={"ID":"f264b5d9-bc95-4e78-b399-43e8148c8768","Type":"ContainerStarted","Data":"d1a58b702b45e2f5ebac5bb7357aa4d726374ff9734e309c593a23ce03859c8b"}
Oct 30 20:38:42.491670 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.491645    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-sbz2m" event={"ID":"e9ba6324-4a54-40b9-8c8c-b2dee0510797","Type":"ContainerStarted","Data":"7d5cbd0e475a30b8668670235dfac19a97c09823e3e25697e97dd66a1b5a68d2"}
Oct 30 20:38:42.491769 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.491677    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-sbz2m" event={"ID":"e9ba6324-4a54-40b9-8c8c-b2dee0510797","Type":"ContainerStarted","Data":"2a32c8d03f6550f6689eaac809b0765b6767c20be6db368aecd22b1c8a75b349"}
Oct 30 20:38:42.492890 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.492863    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qthmt" event={"ID":"7e9d8fb4-c43e-4973-b67b-7cca18f00408","Type":"ContainerStarted","Data":"597cfae78c6505f4046a2c02ed85c0466937a74bcf6c2a785f5c554aeb8db47a"}
Oct 30 20:38:42.493938 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.493923    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-sxgrn" event={"ID":"21b1d440-8b5c-4e0b-b3bf-e74befdce48e","Type":"ContainerStarted","Data":"e1b5aaf381ebaa82a549d5264b9eefef07db6161dfaa63435c49063ee139de21"}
Oct 30 20:38:42.507538 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.507470    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-5rf4c" podStartSLOduration=436.507458781 podStartE2EDuration="7m16.507458781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:31:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:42.506668504 +0000 UTC m=+31.797049432" watchObservedRunningTime="2026-10-30 20:38:42.507458781 +0000 UTC m=+31.797839708"
Oct 30 20:38:42.525086 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.525049    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-sbz2m" podStartSLOduration=435.525042855 podStartE2EDuration="7m15.525042855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:31:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:42.524313369 +0000 UTC m=+31.814694293" watchObservedRunningTime="2026-10-30 20:38:42.525042855 +0000 UTC m=+31.815423782"
Oct 30 20:38:42.544533 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:42.544497    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-cd525" podStartSLOduration=435.544485915 podStartE2EDuration="7m15.544485915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:31:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:42.543882937 +0000 UTC m=+31.834263861" watchObservedRunningTime="2026-10-30 20:38:42.544485915 +0000 UTC m=+31.834866839"
Oct 30 20:38:43.163556 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:43.163508    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:43.163817 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:43.163797    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:43.163925 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:43.163881    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls podName:86386c5c-e63e-4a97-a58e-ee79814a585f nodeName:}" failed. No retries permitted until 2026-10-30 20:38:45.163867814 +0000 UTC m=+34.454248732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-5pmqz" (UID: "86386c5c-e63e-4a97-a58e-ee79814a585f") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:43.169600 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:43.169575    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:43.175142 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:43.174773    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:38:43.175142 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:43.174838    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6zzqh\""
Oct 30 20:38:43.264774 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:43.264742    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:43.264926 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:43.264799    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:43.264926 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:43.264870    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:43.264926 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:43.264906    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:43.265080 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:43.264943    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:43.265080 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:43.264984    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:43.265080 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:43.265025    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:43.265227 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:43.265190    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:43.265227 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:43.265205    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79c6d8c76d-pvcm5: secret "image-registry-tls" not found
Oct 30 20:38:43.265321 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:43.265266    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls podName:90198fcb-a25b-4437-965b-750ede2da138 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:45.265249009 +0000 UTC m=+34.555629919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls") pod "image-registry-79c6d8c76d-pvcm5" (UID: "90198fcb-a25b-4437-965b-750ede2da138") : secret "image-registry-tls" not found
Oct 30 20:38:43.265705 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:43.265665    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle podName:86ced41b-f67d-4a69-9c48-81be43c75698 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:45.265647483 +0000 UTC m=+34.556028392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle") pod "router-default-7fc784755f-fpdq5" (UID: "86ced41b-f67d-4a69-9c48-81be43c75698") : configmap references non-existent config key: service-ca.crt
Oct 30 20:38:43.265799 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:43.265742    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:38:43.265799 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:43.265777    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs podName:86ced41b-f67d-4a69-9c48-81be43c75698 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:45.265764814 +0000 UTC m=+34.556145725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs") pod "router-default-7fc784755f-fpdq5" (UID: "86ced41b-f67d-4a69-9c48-81be43c75698") : secret "router-metrics-certs-default" not found
Oct 30 20:38:43.265894 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:43.265833    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:38:43.265894 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:43.265864    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls podName:75581bb4-9213-4894-ad60-5cbe03c4ff6c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:45.265853889 +0000 UTC m=+34.556234797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xpnhd" (UID: "75581bb4-9213-4894-ad60-5cbe03c4ff6c") : secret "samples-operator-tls" not found
Oct 30 20:38:43.265999 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:43.265918    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:38:43.265999 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:43.265951    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert podName:2c88c202-657d-49fd-83af-da47476931a9 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:45.265941286 +0000 UTC m=+34.556322196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fx72n" (UID: "2c88c202-657d-49fd-83af-da47476931a9") : secret "networking-console-plugin-cert" not found
Oct 30 20:38:43.266123 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:43.266009    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:43.266123 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:43.266018    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fcdccbdf7-r26s9: secret "image-registry-tls" not found
Oct 30 20:38:43.266123 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:43.266047    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls podName:04f91be3-79d3-4f15-a7ba-f2d0bb249e02 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:45.266037294 +0000 UTC m=+34.556418204 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls") pod "image-registry-6fcdccbdf7-r26s9" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02") : secret "image-registry-tls" not found
Oct 30 20:38:43.266123 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:43.266101    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:38:43.266123 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:43.266126    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls podName:d204b46f-c6a4-440f-8078-ce647d423f59 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:45.266117777 +0000 UTC m=+34.556498685 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls") pod "dns-default-xchc6" (UID: "d204b46f-c6a4-440f-8078-ce647d423f59") : secret "dns-default-metrics-tls" not found
Oct 30 20:38:44.881582 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:44.881545    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:44.882028 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:44.881744    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:44.882028 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:44.881926    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 20:38:44.882028 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:44.881985    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs podName:88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c nodeName:}" failed. No retries permitted until 2026-10-30 20:39:16.881967787 +0000 UTC m=+66.172348694 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs") pod "network-metrics-daemon-n7qt5" (UID: "88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c") : secret "metrics-daemon-secret" not found
Oct 30 20:38:44.885943 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:44.885914    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:44.965023 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:44.964985    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:44.982824 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:44.982788    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvkf4\" (UniqueName: \"kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4\") pod \"network-check-target-qwmdw\" (UID: \"cf3347a5-26a7-4708-abb3-e3a39308f782\") " pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:44.987143 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:44.987115    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvkf4\" (UniqueName: \"kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4\") pod \"network-check-target-qwmdw\" (UID: \"cf3347a5-26a7-4708-abb3-e3a39308f782\") " pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:44.987269 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:44.987244    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:45.193623 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:45.192959    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:45.193623 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:45.193191    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:45.193623 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:45.193252    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls podName:86386c5c-e63e-4a97-a58e-ee79814a585f nodeName:}" failed. No retries permitted until 2026-10-30 20:38:49.193235236 +0000 UTC m=+38.483616144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-5pmqz" (UID: "86386c5c-e63e-4a97-a58e-ee79814a585f") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:45.296952 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:45.294314    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:45.296952 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:45.294389    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:45.296952 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:45.294430    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:45.296952 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:45.294478    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:45.296952 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:45.294522    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:45.296952 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:45.294602    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:45.296952 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:45.294625    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:45.296952 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:45.294757    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:38:45.296952 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:45.294816    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs podName:86ced41b-f67d-4a69-9c48-81be43c75698 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:49.294799657 +0000 UTC m=+38.585180567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs") pod "router-default-7fc784755f-fpdq5" (UID: "86ced41b-f67d-4a69-9c48-81be43c75698") : secret "router-metrics-certs-default" not found
Oct 30 20:38:45.296952 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:45.295207    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:38:45.296952 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:45.295260    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls podName:75581bb4-9213-4894-ad60-5cbe03c4ff6c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:49.295246415 +0000 UTC m=+38.585627343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xpnhd" (UID: "75581bb4-9213-4894-ad60-5cbe03c4ff6c") : secret "samples-operator-tls" not found
Oct 30 20:38:45.296952 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:45.295329    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:38:45.296952 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:45.295382    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert podName:2c88c202-657d-49fd-83af-da47476931a9 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:49.295354988 +0000 UTC m=+38.585735893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fx72n" (UID: "2c88c202-657d-49fd-83af-da47476931a9") : secret "networking-console-plugin-cert" not found
Oct 30 20:38:45.296952 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:45.295449    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:45.296952 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:45.295468    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fcdccbdf7-r26s9: secret "image-registry-tls" not found
Oct 30 20:38:45.296952 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:45.295503    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls podName:04f91be3-79d3-4f15-a7ba-f2d0bb249e02 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:49.295492753 +0000 UTC m=+38.585873660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls") pod "image-registry-6fcdccbdf7-r26s9" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02") : secret "image-registry-tls" not found
Oct 30 20:38:45.297939 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:45.295567    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:38:45.297939 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:45.295607    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls podName:d204b46f-c6a4-440f-8078-ce647d423f59 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:49.295596454 +0000 UTC m=+38.585977375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls") pod "dns-default-xchc6" (UID: "d204b46f-c6a4-440f-8078-ce647d423f59") : secret "dns-default-metrics-tls" not found
Oct 30 20:38:45.297939 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:45.295667    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:45.297939 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:45.295679    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79c6d8c76d-pvcm5: secret "image-registry-tls" not found
Oct 30 20:38:45.297939 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:45.295711    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls podName:90198fcb-a25b-4437-965b-750ede2da138 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:49.29570154 +0000 UTC m=+38.586082462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls") pod "image-registry-79c6d8c76d-pvcm5" (UID: "90198fcb-a25b-4437-965b-750ede2da138") : secret "image-registry-tls" not found
Oct 30 20:38:45.300568 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:45.300475    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle podName:86ced41b-f67d-4a69-9c48-81be43c75698 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:49.300451977 +0000 UTC m=+38.590832888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle") pod "router-default-7fc784755f-fpdq5" (UID: "86ced41b-f67d-4a69-9c48-81be43c75698") : configmap references non-existent config key: service-ca.crt
Oct 30 20:38:45.300568 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:45.300344    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jk8sp"]
Oct 30 20:38:45.301873 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:45.301832    2566 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e89d20_b285_4246_8184_9fe736a2c6fb.slice/crio-03e1c06362e3dd7808db1f2e3c0d6b9e5b60fa38bf20da3321a8d430d304d163 WatchSource:0}: Error finding container 03e1c06362e3dd7808db1f2e3c0d6b9e5b60fa38bf20da3321a8d430d304d163: Status 404 returned error can't find the container with id 03e1c06362e3dd7808db1f2e3c0d6b9e5b60fa38bf20da3321a8d430d304d163
Oct 30 20:38:45.329505 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:45.329272    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qwmdw"]
Oct 30 20:38:45.332806 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:45.332772    2566 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf3347a5_26a7_4708_abb3_e3a39308f782.slice/crio-cef38ab9175d6ee2ef1312e86d6385df072e4086052999a485a944e24cf8b4a2 WatchSource:0}: Error finding container cef38ab9175d6ee2ef1312e86d6385df072e4086052999a485a944e24cf8b4a2: Status 404 returned error can't find the container with id cef38ab9175d6ee2ef1312e86d6385df072e4086052999a485a944e24cf8b4a2
Oct 30 20:38:45.517179 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:45.516391    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qthmt" event={"ID":"7e9d8fb4-c43e-4973-b67b-7cca18f00408","Type":"ContainerStarted","Data":"6c05f981a2ca98e861b89d4955e991f95f11064ec291f7153634f595957444c3"}
Oct 30 20:38:45.518787 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:45.518716    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qwmdw" event={"ID":"cf3347a5-26a7-4708-abb3-e3a39308f782","Type":"ContainerStarted","Data":"cef38ab9175d6ee2ef1312e86d6385df072e4086052999a485a944e24cf8b4a2"}
Oct 30 20:38:45.520123 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:45.520066    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jk8sp" event={"ID":"34e89d20-b285-4246-8184-9fe736a2c6fb","Type":"ContainerStarted","Data":"03e1c06362e3dd7808db1f2e3c0d6b9e5b60fa38bf20da3321a8d430d304d163"}
Oct 30 20:38:45.536852 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:45.536787    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qthmt" podStartSLOduration=416.107131529 podStartE2EDuration="6m58.536771174s" totalImagesPullingTime="2.429639645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:45.536494106 +0000 UTC m=+34.826875044" watchObservedRunningTime="2026-10-30 20:38:45.536771174 +0000 UTC m=+34.827152103"
Oct 30 20:38:45.787100 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:45.787067    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:45.987789 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:45.987721    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:47.422670 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:47.422630    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:47.638283 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:47.637074    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:48.210872 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.209863    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kjcfz"]
Oct 30 20:38:48.233390 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.232829    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kjcfz"]
Oct 30 20:38:48.233390 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.232944    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:48.320172 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.320111    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 20:38:48.320172 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.320115    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 20:38:48.320172 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.320176    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6gb67\""
Oct 30 20:38:48.325843 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.325816    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:48.432732 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.432268    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93430674-7eab-453f-a278-c8d352572441-crio-socket\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:48.432732 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.432348    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:48.432732 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.432416    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wwsv\" (UniqueName: \"kubernetes.io/projected/93430674-7eab-453f-a278-c8d352572441-kube-api-access-5wwsv\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:48.432732 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.432507    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93430674-7eab-453f-a278-c8d352572441-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:48.432732 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.432592    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93430674-7eab-453f-a278-c8d352572441-data-volume\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:48.535226 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.535131    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:48.535226 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.535195    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wwsv\" (UniqueName: \"kubernetes.io/projected/93430674-7eab-453f-a278-c8d352572441-kube-api-access-5wwsv\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:48.535480 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.535297    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93430674-7eab-453f-a278-c8d352572441-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:48.535588 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:48.535571    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:48.535652 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:48.535582    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 20:38:48.535652 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:48.535631    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls podName:93430674-7eab-453f-a278-c8d352572441 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:49.035615185 +0000 UTC m=+38.325996106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjcfz" (UID: "93430674-7eab-453f-a278-c8d352572441") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:48.535652 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:48.535648    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93430674-7eab-453f-a278-c8d352572441-kube-rbac-proxy-cm podName:93430674-7eab-453f-a278-c8d352572441 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:49.035640669 +0000 UTC m=+38.326021574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93430674-7eab-453f-a278-c8d352572441-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kjcfz" (UID: "93430674-7eab-453f-a278-c8d352572441") : configmap "kube-rbac-proxy" not found
Oct 30 20:38:48.535819 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.535695    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93430674-7eab-453f-a278-c8d352572441-data-volume\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:48.536330 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.536301    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93430674-7eab-453f-a278-c8d352572441-crio-socket\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:48.536455 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.536391    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93430674-7eab-453f-a278-c8d352572441-data-volume\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:48.536499 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.536450    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93430674-7eab-453f-a278-c8d352572441-crio-socket\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:48.542571 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.542523    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:48.545326 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.545299    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-sxgrn" event={"ID":"21b1d440-8b5c-4e0b-b3bf-e74befdce48e","Type":"ContainerStarted","Data":"b50bc4cdbabeb98d558c36549f9d82c713b67cfae4a7f8e0da7f37579cdcc00d"}
Oct 30 20:38:48.547451 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.547402    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4" event={"ID":"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c","Type":"ContainerStarted","Data":"cabd5efd22623e42a0f0189d048ced248b4b08fd725486283d324df7dda61d2b"}
Oct 30 20:38:48.549526 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.549246    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m" event={"ID":"b2a12cab-f546-4344-8460-3f967e181eeb","Type":"ContainerStarted","Data":"1705e6fcb2996d2c62223b59879fc373d51c933d97bd137384e1eaaf1017f666"}
Oct 30 20:38:48.551557 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.551536    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/0.log"
Oct 30 20:38:48.551647 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.551587    2566 generic.go:356] "Generic (PLEG): container finished" podID="9d262282-6f9c-4945-959d-81e9a9a12392" containerID="06ca095521fc9bb43a28d66b06e792cf1f58e79bd70cfb200109e9d3bc4d73b5" exitCode=255
Oct 30 20:38:48.551703 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.551682    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq" event={"ID":"9d262282-6f9c-4945-959d-81e9a9a12392","Type":"ContainerDied","Data":"06ca095521fc9bb43a28d66b06e792cf1f58e79bd70cfb200109e9d3bc4d73b5"}
Oct 30 20:38:48.551870 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.551854    2566 scope.go:122] "RemoveContainer" containerID="06ca095521fc9bb43a28d66b06e792cf1f58e79bd70cfb200109e9d3bc4d73b5"
Oct 30 20:38:48.553993 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.553944    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wwsv\" (UniqueName: \"kubernetes.io/projected/93430674-7eab-453f-a278-c8d352572441-kube-api-access-5wwsv\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:48.555036 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.555015    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gxp9z" event={"ID":"2d040316-e799-40d0-b5ee-2a4351ca99bd","Type":"ContainerStarted","Data":"c9b385371b3c24b5fe7830dc6a4618dfcfe9b40a86b40f01412bdbf13d821dd9"}
Oct 30 20:38:48.568779 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.568732    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-sxgrn" podStartSLOduration=419.303992202 podStartE2EDuration="7m4.568720224s" totalImagesPullingTime="5.264728022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:48.567866344 +0000 UTC m=+37.858247274" watchObservedRunningTime="2026-10-30 20:38:48.568720224 +0000 UTC m=+37.859101150"
Oct 30 20:38:48.644050 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.643554    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4" podStartSLOduration=420.382603697 podStartE2EDuration="7m5.643540262s" totalImagesPullingTime="5.260936565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:48.619307493 +0000 UTC m=+37.909688424" watchObservedRunningTime="2026-10-30 20:38:48.643540262 +0000 UTC m=+37.933921188"
Oct 30 20:38:48.644050 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.643860    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m" podStartSLOduration=419.379146579 podStartE2EDuration="7m4.643853605s" totalImagesPullingTime="5.264707026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:48.64208502 +0000 UTC m=+37.932465948" watchObservedRunningTime="2026-10-30 20:38:48.643853605 +0000 UTC m=+37.934234532"
Oct 30 20:38:48.769892 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.769863    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:48.828215 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.828115    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gxp9z" podStartSLOduration=2.226372425 podStartE2EDuration="7.828093021s" totalImagesPullingTime="5.601720596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:48.664785146 +0000 UTC m=+37.955166076" watchObservedRunningTime="2026-10-30 20:38:48.828093021 +0000 UTC m=+38.118473951"
Oct 30 20:38:48.828700 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.828677    2566 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-49kcm"]
Oct 30 20:38:48.843312 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.843283    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-49kcm"]
Oct 30 20:38:48.843450 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.843392    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-49kcm"
Oct 30 20:38:48.852171 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.852148    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:48.852291 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.852276    2566 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8f8mm\""
Oct 30 20:38:48.852352 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.852343    2566 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 20:38:48.941988 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.941950    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt4gk\" (UniqueName: \"kubernetes.io/projected/a531c68c-5ab5-408a-ae30-640a1bc4c8ab-kube-api-access-mt4gk\") pod \"migrator-66df5d496b-49kcm\" (UID: \"a531c68c-5ab5-408a-ae30-640a1bc4c8ab\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-49kcm"
Oct 30 20:38:48.976679 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:48.976569    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:49.043269 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.043238    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93430674-7eab-453f-a278-c8d352572441-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:49.043445 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.043384    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt4gk\" (UniqueName: \"kubernetes.io/projected/a531c68c-5ab5-408a-ae30-640a1bc4c8ab-kube-api-access-mt4gk\") pod \"migrator-66df5d496b-49kcm\" (UID: \"a531c68c-5ab5-408a-ae30-640a1bc4c8ab\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-49kcm"
Oct 30 20:38:49.043445 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.043392    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 20:38:49.043537 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.043444    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:49.043537 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.043501    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93430674-7eab-453f-a278-c8d352572441-kube-rbac-proxy-cm podName:93430674-7eab-453f-a278-c8d352572441 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:50.043479408 +0000 UTC m=+39.333860318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93430674-7eab-453f-a278-c8d352572441-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kjcfz" (UID: "93430674-7eab-453f-a278-c8d352572441") : configmap "kube-rbac-proxy" not found
Oct 30 20:38:49.043648 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.043577    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:49.043648 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.043634    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls podName:93430674-7eab-453f-a278-c8d352572441 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:50.043616386 +0000 UTC m=+39.333997351 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjcfz" (UID: "93430674-7eab-453f-a278-c8d352572441") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:49.056644 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.056619    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt4gk\" (UniqueName: \"kubernetes.io/projected/a531c68c-5ab5-408a-ae30-640a1bc4c8ab-kube-api-access-mt4gk\") pod \"migrator-66df5d496b-49kcm\" (UID: \"a531c68c-5ab5-408a-ae30-640a1bc4c8ab\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-49kcm"
Oct 30 20:38:49.167922 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.167891    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-49kcm"
Oct 30 20:38:49.176940 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.176907    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:49.244908 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.244871    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:49.245122 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.245105    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:49.245187 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.245175    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls podName:86386c5c-e63e-4a97-a58e-ee79814a585f nodeName:}" failed. No retries permitted until 2026-10-30 20:38:57.245155983 +0000 UTC m=+46.535536911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-5pmqz" (UID: "86386c5c-e63e-4a97-a58e-ee79814a585f") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:49.346664 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.346627    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:49.346785 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.346750    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:49.346843 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.346779    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:49.346896 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.346843    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:49.346896 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.346877    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:49.347001 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.346914    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:49.347001 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.346955    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:49.347743 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.347091    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:38:49.347743 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.347161    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls podName:d204b46f-c6a4-440f-8078-ce647d423f59 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:57.347140978 +0000 UTC m=+46.637521897 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls") pod "dns-default-xchc6" (UID: "d204b46f-c6a4-440f-8078-ce647d423f59") : secret "dns-default-metrics-tls" not found
Oct 30 20:38:49.347743 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.347188    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:49.347743 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.347208    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79c6d8c76d-pvcm5: secret "image-registry-tls" not found
Oct 30 20:38:49.347743 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.347246    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls podName:90198fcb-a25b-4437-965b-750ede2da138 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:57.347234202 +0000 UTC m=+46.637615123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls") pod "image-registry-79c6d8c76d-pvcm5" (UID: "90198fcb-a25b-4437-965b-750ede2da138") : secret "image-registry-tls" not found
Oct 30 20:38:49.347743 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.347294    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle podName:86ced41b-f67d-4a69-9c48-81be43c75698 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:57.347288068 +0000 UTC m=+46.637669014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle") pod "router-default-7fc784755f-fpdq5" (UID: "86ced41b-f67d-4a69-9c48-81be43c75698") : configmap references non-existent config key: service-ca.crt
Oct 30 20:38:49.347743 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.347336    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:38:49.347743 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.347356    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs podName:86ced41b-f67d-4a69-9c48-81be43c75698 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:57.347349714 +0000 UTC m=+46.637730679 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs") pod "router-default-7fc784755f-fpdq5" (UID: "86ced41b-f67d-4a69-9c48-81be43c75698") : secret "router-metrics-certs-default" not found
Oct 30 20:38:49.347743 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.347410    2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:38:49.347743 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.347428    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls podName:75581bb4-9213-4894-ad60-5cbe03c4ff6c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:57.347422327 +0000 UTC m=+46.637803273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xpnhd" (UID: "75581bb4-9213-4894-ad60-5cbe03c4ff6c") : secret "samples-operator-tls" not found
Oct 30 20:38:49.347743 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.347499    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:49.347743 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.347515    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fcdccbdf7-r26s9: secret "image-registry-tls" not found
Oct 30 20:38:49.347743 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.347536    2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:38:49.347743 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.347558    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls podName:04f91be3-79d3-4f15-a7ba-f2d0bb249e02 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:57.347543968 +0000 UTC m=+46.637924886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls") pod "image-registry-6fcdccbdf7-r26s9" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02") : secret "image-registry-tls" not found
Oct 30 20:38:49.347743 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.347581    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert podName:2c88c202-657d-49fd-83af-da47476931a9 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:57.347568102 +0000 UTC m=+46.637949227 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fx72n" (UID: "2c88c202-657d-49fd-83af-da47476931a9") : secret "networking-console-plugin-cert" not found
Oct 30 20:38:49.374573 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.374423    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:49.560512 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.560435    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h5lvt" event={"ID":"dda1e37e-2f98-46b0-8ad9-632d308a5744","Type":"ContainerStarted","Data":"a15b5bf67e1c4ac1c016540c8234f60e32decf9e775fd6d7367827b908d2af2d"}
Oct 30 20:38:49.562336 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.562315    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/1.log"
Oct 30 20:38:49.562873 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.562856    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/0.log"
Oct 30 20:38:49.562964 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.562895    2566 generic.go:356] "Generic (PLEG): container finished" podID="9d262282-6f9c-4945-959d-81e9a9a12392" containerID="06135342ee3628b382371bbace43209766db17b7fa0070231425c40fbe4e46a3" exitCode=255
Oct 30 20:38:49.563012 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.562994    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq" event={"ID":"9d262282-6f9c-4945-959d-81e9a9a12392","Type":"ContainerDied","Data":"06135342ee3628b382371bbace43209766db17b7fa0070231425c40fbe4e46a3"}
Oct 30 20:38:49.563084 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.563068    2566 scope.go:122] "RemoveContainer" containerID="06ca095521fc9bb43a28d66b06e792cf1f58e79bd70cfb200109e9d3bc4d73b5"
Oct 30 20:38:49.563181 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.563158    2566 scope.go:122] "RemoveContainer" containerID="06135342ee3628b382371bbace43209766db17b7fa0070231425c40fbe4e46a3"
Oct 30 20:38:49.563399 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:49.563375    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-pjhmq_openshift-console-operator(9d262282-6f9c-4945-959d-81e9a9a12392)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq" podUID="9d262282-6f9c-4945-959d-81e9a9a12392"
Oct 30 20:38:49.580534 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.580485    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h5lvt" podStartSLOduration=405.506859117 podStartE2EDuration="6m52.580468916s" totalImagesPullingTime="7.073609799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:49.579510403 +0000 UTC m=+38.869891329" watchObservedRunningTime="2026-10-30 20:38:49.580468916 +0000 UTC m=+38.870849855"
Oct 30 20:38:49.586867 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:49.586844    2566 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-49kcm"]
Oct 30 20:38:49.591250 ip-10-0-142-183 kubenswrapper[2566]: W1030 20:38:49.591228    2566 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda531c68c_5ab5_408a_ae30_640a1bc4c8ab.slice/crio-fd8f1b9a24905e5bc02c07df1384a12eccddf943c0175509cb18848efd0c7100 WatchSource:0}: Error finding container fd8f1b9a24905e5bc02c07df1384a12eccddf943c0175509cb18848efd0c7100: Status 404 returned error can't find the container with id fd8f1b9a24905e5bc02c07df1384a12eccddf943c0175509cb18848efd0c7100
Oct 30 20:38:50.055659 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:50.055626    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:50.055844 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:50.055748    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93430674-7eab-453f-a278-c8d352572441-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:50.055844 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:50.055794    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:50.055844 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:50.055835    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 20:38:50.055995 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:50.055861    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls podName:93430674-7eab-453f-a278-c8d352572441 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:52.05584375 +0000 UTC m=+41.346224676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjcfz" (UID: "93430674-7eab-453f-a278-c8d352572441") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:50.055995 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:50.055880    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/93430674-7eab-453f-a278-c8d352572441-kube-rbac-proxy-cm podName:93430674-7eab-453f-a278-c8d352572441 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:52.055870503 +0000 UTC m=+41.346251408 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/93430674-7eab-453f-a278-c8d352572441-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kjcfz" (UID: "93430674-7eab-453f-a278-c8d352572441") : configmap "kube-rbac-proxy" not found
Oct 30 20:38:50.294001 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:50.293924    2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:50.568702 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:50.568669    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/1.log"
Oct 30 20:38:50.569060 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:50.569035    2566 scope.go:122] "RemoveContainer" containerID="06135342ee3628b382371bbace43209766db17b7fa0070231425c40fbe4e46a3"
Oct 30 20:38:50.569211 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:50.569190    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-pjhmq_openshift-console-operator(9d262282-6f9c-4945-959d-81e9a9a12392)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq" podUID="9d262282-6f9c-4945-959d-81e9a9a12392"
Oct 30 20:38:50.571826 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:50.571799    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-49kcm" event={"ID":"a531c68c-5ab5-408a-ae30-640a1bc4c8ab","Type":"ContainerStarted","Data":"fd8f1b9a24905e5bc02c07df1384a12eccddf943c0175509cb18848efd0c7100"}
Oct 30 20:38:50.573750 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:50.573698    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qwmdw" event={"ID":"cf3347a5-26a7-4708-abb3-e3a39308f782","Type":"ContainerStarted","Data":"d8a78622006318fc43337ae84d831713cfd2e3ba1c1bb882e1bc08ee9d1da0f5"}
Oct 30 20:38:50.611873 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:50.611821    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qwmdw" podStartSLOduration=33.706212768 podStartE2EDuration="38.61180301s" totalImagesPullingTime="4.905590242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:50.610482487 +0000 UTC m=+39.900863414" watchObservedRunningTime="2026-10-30 20:38:50.61180301 +0000 UTC m=+39.902183937"
Oct 30 20:38:51.578496 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:51.578414    2566 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-49kcm" event={"ID":"a531c68c-5ab5-408a-ae30-640a1bc4c8ab","Type":"ContainerStarted","Data":"1a36f947d6482f8378505017189434448b4084b194a0f2992d4b78be71fbb27d"}
Oct 30 20:38:51.578839 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:51.578686    2566 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:51.597082 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:51.597038    2566 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-49kcm" podStartSLOduration=1.908208248 podStartE2EDuration="3.597025747s" totalImagesPullingTime="1.688817499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:51.596109515 +0000 UTC m=+40.886490443" watchObservedRunningTime="2026-10-30 20:38:51.597025747 +0000 UTC m=+40.887406674"
Oct 30 20:38:51.796022 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:51.795983    2566 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:51.796137 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:51.796068    2566 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:51.796457 ip-10-0-142-183 kubenswrapper[2566]: I1030 20:38:51.796441    2566 scope.go:122] "RemoveContainer" containerID="06135342ee3628b382371bbace43209766db17b7fa0070231425c40fbe4e46a3"
Oct 30 20:38:51.796648 ip-10-0-142-183 kubenswrapper[2566]: E1030 20:38:51.796630    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-pjhmq_openshift-console-operator(9d262282-6f9c-4945-959d-81e9a9a12392)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq" podUID="9d262282-6f9c-4945-959d-81e9a9a12392"
Oct 30 20:38:52.068569 ip-10-0-142-183 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 20:38:52.092723 ip-10-0-142-183 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 20:38:52.092892 ip-10-0-142-183 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 20:38:52.092939 ip-10-0-142-183 systemd[1]: kubelet.service: Consumed 2.848s CPU time.
Oct 30 20:38:52.104066 ip-10-0-142-183 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 20:38:52.210289 ip-10-0-142-183 kubenswrapper[4948]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:52.210289 ip-10-0-142-183 kubenswrapper[4948]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 20:38:52.210289 ip-10-0-142-183 kubenswrapper[4948]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:52.210289 ip-10-0-142-183 kubenswrapper[4948]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:52.212318 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212235    4948 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:52.212318 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212319    4948 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212323    4948 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212326    4948 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212329    4948 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212332    4948 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212335    4948 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212338    4948 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212340    4948 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212343    4948 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212346    4948 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212349    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212352    4948 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212355    4948 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212375    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212378    4948 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212381    4948 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212384    4948 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212387    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212390    4948 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212402    4948 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:52.212417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212405    4948 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212408    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212411    4948 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212413    4948 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212416    4948 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212419    4948 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212422    4948 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212424    4948 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212428    4948 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212431    4948 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212433    4948 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212436    4948 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212439    4948 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212441    4948 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212444    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212446    4948 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212449    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212451    4948 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212455    4948 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212457    4948 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:52.212946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212460    4948 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212463    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212467    4948 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212471    4948 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212474    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212478    4948 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212481    4948 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212484    4948 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212487    4948 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212490    4948 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212493    4948 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212495    4948 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212498    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212500    4948 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212504    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212506    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212509    4948 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212512    4948 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212515    4948 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:52.213478 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212518    4948 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212520    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212523    4948 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212525    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212528    4948 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212531    4948 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212533    4948 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212546    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212550    4948 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212552    4948 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212555    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212558    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212567    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212570    4948 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212573    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212576    4948 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212579    4948 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212581    4948 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212584    4948 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212587    4948 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:52.213958 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212590    4948 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212592    4948 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212595    4948 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212597    4948 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212600    4948 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212603    4948 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212605    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212608    4948 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212611    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212613    4948 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212616    4948 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212619    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212621    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212624    4948 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212627    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212632    4948 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212635    4948 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212639    4948 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212642    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:52.214470 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212644    4948 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212647    4948 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212650    4948 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212652    4948 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212655    4948 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212657    4948 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.212668    4948 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213456    4948 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213463    4948 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213466    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213469    4948 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213471    4948 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213480    4948 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213483    4948 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213486    4948 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213489    4948 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213492    4948 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213494    4948 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213497    4948 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213500    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:52.214954 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213503    4948 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213506    4948 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213509    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213512    4948 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213514    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213517    4948 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213520    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213522    4948 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213525    4948 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213528    4948 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213530    4948 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213533    4948 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213536    4948 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213540    4948 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213543    4948 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213546    4948 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213549    4948 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213556    4948 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213559    4948 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:52.215517 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213567    4948 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213570    4948 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213573    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213575    4948 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213578    4948 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213581    4948 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213583    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213586    4948 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213589    4948 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213591    4948 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213594    4948 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213596    4948 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213599    4948 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213602    4948 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213604    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213607    4948 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213610    4948 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213612    4948 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213615    4948 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213617    4948 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:52.216000 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213620    4948 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213622    4948 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213625    4948 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213628    4948 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213630    4948 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213633    4948 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213635    4948 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213638    4948 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213640    4948 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213643    4948 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213649    4948 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213653    4948 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213656    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213665    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213668    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213671    4948 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213673    4948 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213676    4948 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213679    4948 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:52.216524 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213682    4948 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213684    4948 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213686    4948 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213689    4948 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213692    4948 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213694    4948 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213697    4948 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213700    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213702    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213705    4948 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213707    4948 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213710    4948 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213713    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213715    4948 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213718    4948 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213720    4948 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213723    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213725    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213731    4948 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:52.217033 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213734    4948 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213736    4948 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213739    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213742    4948 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213745    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213748    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213751    4948 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213753    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213763    4948 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213766    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213768    4948 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213771    4948 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213778    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213781    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213783    4948 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.213786    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214379    4948 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214385    4948 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214388    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:52.217520 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214391    4948 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214394    4948 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214397    4948 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214399    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214403    4948 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214406    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214409    4948 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214412    4948 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214414    4948 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214417    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214419    4948 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214422    4948 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214425    4948 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214427    4948 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214430    4948 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214433    4948 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214437    4948 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214443    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214446    4948 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:52.218011 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214449    4948 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214452    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214457    4948 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214459    4948 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214463    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214465    4948 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214468    4948 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214470    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214473    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214476    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214479    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214482    4948 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214484    4948 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214487    4948 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214490    4948 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214493    4948 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214495    4948 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214498    4948 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214500    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:52.218551 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214503    4948 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214505    4948 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214508    4948 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214511    4948 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214514    4948 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214519    4948 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214522    4948 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214524    4948 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214527    4948 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214530    4948 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214533    4948 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214537    4948 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214540    4948 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214543    4948 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214545    4948 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214548    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214553    4948 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214557    4948 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214561    4948 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:52.219316 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214565    4948 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214569    4948 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214573    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214577    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214582    4948 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214586    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214589    4948 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214592    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214595    4948 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214597    4948 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214601    4948 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214604    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214606    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214609    4948 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214611    4948 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214614    4948 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214617    4948 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214619    4948 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214622    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214624    4948 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:52.219834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214627    4948 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214629    4948 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214632    4948 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214634    4948 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214638    4948 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214641    4948 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214643    4948 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214646    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214648    4948 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214651    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214654    4948 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214657    4948 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214660    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214662    4948 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214665    4948 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214667    4948 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214670    4948 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214672    4948 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214675    4948 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:52.220332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214678    4948 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214680    4948 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214683    4948 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214685    4948 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214688    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214691    4948 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.214693    4948 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214780    4948 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214795    4948 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214807    4948 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214814    4948 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214819    4948 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214823    4948 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214827    4948 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214831    4948 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214835    4948 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214838    4948 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214844    4948 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214847    4948 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214850    4948 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214853    4948 flags.go:64] FLAG: --cgroup-root=""
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214857    4948 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214860    4948 flags.go:64] FLAG: --client-ca-file=""
Oct 30 20:38:52.220857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214863    4948 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214867    4948 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214872    4948 flags.go:64] FLAG: --cluster-domain=""
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214875    4948 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214878    4948 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214881    4948 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214884    4948 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214889    4948 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214892    4948 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214895    4948 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214898    4948 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214902    4948 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214905    4948 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214908    4948 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214911    4948 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214914    4948 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214919    4948 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214923    4948 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214927    4948 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214930    4948 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214934    4948 flags.go:64] FLAG: --enable-server="true"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214937    4948 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214941    4948 flags.go:64] FLAG: --event-burst="100"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214944    4948 flags.go:64] FLAG: --event-qps="50"
Oct 30 20:38:52.221433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214947    4948 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214950    4948 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214954    4948 flags.go:64] FLAG: --eviction-hard=""
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214959    4948 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214962    4948 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214966    4948 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214969    4948 flags.go:64] FLAG: --eviction-soft=""
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214972    4948 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214975    4948 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214978    4948 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214982    4948 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214985    4948 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214988    4948 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214990    4948 flags.go:64] FLAG: --feature-gates=""
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214995    4948 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.214998    4948 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215001    4948 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215004    4948 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215008    4948 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215011    4948 flags.go:64] FLAG: --help="false"
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215014    4948 flags.go:64] FLAG: --hostname-override="ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215017    4948 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215020    4948 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 20:38:52.222063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215023    4948 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215027    4948 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215032    4948 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215035    4948 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215038    4948 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215041    4948 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215044    4948 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215047    4948 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215050    4948 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215053    4948 flags.go:64] FLAG: --kube-reserved=""
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215056    4948 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215060    4948 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215063    4948 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215066    4948 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215069    4948 flags.go:64] FLAG: --lock-file=""
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215072    4948 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215075    4948 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215078    4948 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215083    4948 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215086    4948 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215090    4948 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215093    4948 flags.go:64] FLAG: --logging-format="text"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215096    4948 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215099    4948 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 20:38:52.222681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215102    4948 flags.go:64] FLAG: --manifest-url=""
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215105    4948 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215109    4948 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215112    4948 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215116    4948 flags.go:64] FLAG: --max-pods="110"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215119    4948 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215122    4948 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215125    4948 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215128    4948 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215131    4948 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215135    4948 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215138    4948 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215144    4948 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215148    4948 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215151    4948 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215154    4948 flags.go:64] FLAG: --pod-cidr=""
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215157    4948 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215160    4948 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215163    4948 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215166    4948 flags.go:64] FLAG: --port="10250"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215169    4948 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215173    4948 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0de095b62538ecf45"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215176    4948 flags.go:64] FLAG: --qos-reserved=""
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215179    4948 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215183    4948 flags.go:64] FLAG: --register-node="true"
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215186    4948 flags.go:64] FLAG: --register-with-taints=""
Oct 30 20:38:52.223294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215190    4948 flags.go:64] FLAG: --registry-burst="10"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215193    4948 flags.go:64] FLAG: --registry-qps="5"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215196    4948 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215199    4948 flags.go:64] FLAG: --reserved-memory=""
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215203    4948 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215207    4948 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215210    4948 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215213    4948 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215215    4948 flags.go:64] FLAG: --runonce="false"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215218    4948 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215222    4948 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215225    4948 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215228    4948 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215230    4948 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215234    4948 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215237    4948 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215241    4948 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215244    4948 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215247    4948 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215250    4948 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215253    4948 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215256    4948 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215259    4948 flags.go:64] FLAG: --system-cgroups=""
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215262    4948 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215267    4948 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 20:38:52.223945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215270    4948 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215273    4948 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215277    4948 flags.go:64] FLAG: --tls-min-version=""
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215280    4948 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215283    4948 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215286    4948 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215289    4948 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215292    4948 flags.go:64] FLAG: --v="2"
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215296    4948 flags.go:64] FLAG: --version="false"
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215300    4948 flags.go:64] FLAG: --vmodule=""
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215304    4948 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215311    4948 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215466    4948 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215470    4948 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215473    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215477    4948 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215479    4948 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215482    4948 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215485    4948 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215488    4948 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215491    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215493    4948 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215496    4948 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:52.224609 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215500    4948 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215503    4948 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215506    4948 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215509    4948 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215511    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215514    4948 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215517    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215519    4948 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215522    4948 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215525    4948 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215528    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215530    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215533    4948 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215536    4948 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215538    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215541    4948 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215543    4948 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215546    4948 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215548    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215551    4948 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:52.225188 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215553    4948 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215558    4948 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215561    4948 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215563    4948 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215566    4948 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215568    4948 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215571    4948 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215573    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215576    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215578    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215581    4948 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215583    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215587    4948 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215590    4948 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215593    4948 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215595    4948 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215598    4948 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215600    4948 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215603    4948 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:52.225794 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215606    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215608    4948 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215611    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215614    4948 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215616    4948 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215619    4948 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215622    4948 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215624    4948 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215627    4948 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215630    4948 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215632    4948 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215635    4948 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215637    4948 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215640    4948 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215647    4948 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215650    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215653    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215655    4948 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215658    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215661    4948 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:52.226301 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215663    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215666    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215669    4948 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215671    4948 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215674    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215679    4948 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215682    4948 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215686    4948 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215689    4948 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215692    4948 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215695    4948 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215698    4948 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215701    4948 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215704    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215707    4948 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215709    4948 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215712    4948 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215715    4948 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215718    4948 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:52.226802 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215720    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:52.227280 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215723    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:52.227280 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215725    4948 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:52.227280 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215728    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:52.227280 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215731    4948 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:52.227280 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215734    4948 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:52.227280 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215737    4948 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:52.227280 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215740    4948 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:52.227280 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215743    4948 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:52.227280 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215746    4948 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:52.227280 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215749    4948 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:52.227280 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215752    4948 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:52.227280 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215755    4948 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:52.227280 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215759    4948 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:52.227280 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215762    4948 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:52.227280 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215765    4948 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:52.227280 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215768    4948 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:52.227746 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.215795    4948 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:52.227746 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215835    4948 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:52.227746 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215839    4948 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:52.227746 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215843    4948 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:52.227746 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215847    4948 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:52.227746 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215849    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:52.227746 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215852    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:52.227746 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215855    4948 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:52.227746 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215858    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:52.227746 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215860    4948 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:52.227746 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215863    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:52.227746 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215866    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:52.227746 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215868    4948 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:52.227746 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215871    4948 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:52.227746 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215873    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215877    4948 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215881    4948 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215885    4948 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215888    4948 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215890    4948 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215893    4948 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215896    4948 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215899    4948 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215904    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215907    4948 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215910    4948 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215912    4948 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215915    4948 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215918    4948 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215921    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215923    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215926    4948 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215928    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:52.228117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215932    4948 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215935    4948 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215938    4948 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215940    4948 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215943    4948 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215945    4948 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215948    4948 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215953    4948 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215957    4948 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215961    4948 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215964    4948 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215967    4948 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215970    4948 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215974    4948 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215977    4948 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215979    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215982    4948 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215985    4948 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215987    4948 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:52.228692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215989    4948 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215992    4948 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215995    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.215999    4948 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216002    4948 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216005    4948 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216008    4948 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216011    4948 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216014    4948 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216017    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216019    4948 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216022    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216024    4948 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216028    4948 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216031    4948 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216034    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216036    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216039    4948 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216041    4948 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216044    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:52.229271 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216046    4948 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216049    4948 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216051    4948 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216054    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216057    4948 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216059    4948 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216062    4948 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216065    4948 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216067    4948 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216070    4948 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216072    4948 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216075    4948 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216077    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216080    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216082    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216086    4948 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216089    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216091    4948 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216094    4948 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:52.229788 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216097    4948 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216100    4948 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216102    4948 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216105    4948 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216107    4948 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216110    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216114    4948 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216116    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216119    4948 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216122    4948 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216125    4948 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216128    4948 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216131    4948 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216133    4948 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216136    4948 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.216138    4948 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.221039    4948 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.221055    4948 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.221074    4948 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.221078    4948 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 20:38:52.230259 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221138    4948 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221143    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221146    4948 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221150    4948 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221153    4948 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221156    4948 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221159    4948 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221162    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221165    4948 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221168    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221171    4948 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221173    4948 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221176    4948 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221179    4948 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221181    4948 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221184    4948 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221186    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221189    4948 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221192    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221195    4948 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:52.230757 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221197    4948 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221200    4948 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221203    4948 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221205    4948 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221208    4948 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221210    4948 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221213    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221220    4948 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221224    4948 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221226    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221229    4948 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221232    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221234    4948 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221237    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221240    4948 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221243    4948 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221245    4948 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221248    4948 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221250    4948 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221253    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:52.231304 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221256    4948 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221258    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221261    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221264    4948 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221266    4948 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221269    4948 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221272    4948 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221275    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221277    4948 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221280    4948 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221282    4948 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221285    4948 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221287    4948 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221290    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221292    4948 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221295    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221298    4948 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221301    4948 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221303    4948 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:52.231821 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221306    4948 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221308    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221311    4948 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221313    4948 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221316    4948 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221318    4948 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221321    4948 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221324    4948 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221326    4948 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221329    4948 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221332    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221334    4948 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221337    4948 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221340    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221343    4948 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221345    4948 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221348    4948 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221350    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221353    4948 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221374    4948 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:52.232273 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221380    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221382    4948 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221385    4948 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221388    4948 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221390    4948 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221395    4948 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221398    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221402    4948 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221405    4948 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221409    4948 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221413    4948 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221416    4948 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221418    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221421    4948 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221423    4948 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221426    4948 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221428    4948 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221431    4948 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221434    4948 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:52.232914 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221437    4948 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:52.233404 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221439    4948 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:52.233404 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221442    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:52.233404 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221445    4948 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:52.233404 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221448    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:52.233404 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221451    4948 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:52.233404 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221453    4948 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:52.233404 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221456    4948 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:52.233404 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.221483    4948 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:52.233404 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221638    4948 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:52.233404 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221643    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:52.233404 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221647    4948 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:52.233404 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221649    4948 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:52.233404 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221652    4948 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:52.233404 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221656    4948 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:52.233404 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221658    4948 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:52.233404 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221661    4948 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221663    4948 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221666    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221668    4948 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221671    4948 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221674    4948 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221676    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221679    4948 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221681    4948 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221684    4948 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221686    4948 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221689    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221691    4948 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221694    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221696    4948 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221699    4948 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221702    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221704    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221707    4948 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:52.233826 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221710    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221712    4948 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221715    4948 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221720    4948 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221723    4948 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221726    4948 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221729    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221731    4948 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221734    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221737    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221740    4948 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221742    4948 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221745    4948 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221748    4948 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221751    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221753    4948 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221756    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221759    4948 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221762    4948 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:52.234324 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221764    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221768    4948 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221772    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221775    4948 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221778    4948 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221781    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221783    4948 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221786    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221788    4948 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221791    4948 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221794    4948 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221796    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221799    4948 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221801    4948 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221804    4948 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221806    4948 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221810    4948 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221813    4948 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221816    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:52.234838 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221819    4948 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221822    4948 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221824    4948 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221827    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221829    4948 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221832    4948 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221834    4948 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221837    4948 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221840    4948 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221843    4948 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221846    4948 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221848    4948 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221851    4948 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221854    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221856    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221859    4948 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221861    4948 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221864    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221866    4948 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:52.235291 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221869    4948 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221871    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221874    4948 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221876    4948 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221879    4948 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221882    4948 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221885    4948 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221887    4948 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221890    4948 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221892    4948 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221897    4948 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221899    4948 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221902    4948 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221905    4948 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221907    4948 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221911    4948 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221915    4948 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221918    4948 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221920    4948 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221923    4948 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:52.235872 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221926    4948 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:52.236692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221929    4948 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:52.236692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221932    4948 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:52.236692 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.221954    4948 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:52.236692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221984    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:52.236692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221988    4948 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:52.236692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221991    4948 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:52.236692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221995    4948 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:52.236692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.221998    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:52.236692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222000    4948 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:52.236692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222003    4948 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:52.236692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222006    4948 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:52.236692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222008    4948 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:52.236692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222011    4948 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:52.236692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222014    4948 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:52.236692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222017    4948 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:52.236692 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222019    4948 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222022    4948 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222025    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222027    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222030    4948 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222032    4948 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222037    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222041    4948 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222044    4948 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222047    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222050    4948 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222052    4948 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222055    4948 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222057    4948 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222060    4948 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222063    4948 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222066    4948 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222069    4948 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222072    4948 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222075    4948 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:52.237249 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222078    4948 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222080    4948 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222083    4948 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222086    4948 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222090    4948 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222093    4948 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222095    4948 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222098    4948 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222101    4948 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222103    4948 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222106    4948 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222108    4948 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222111    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222113    4948 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222116    4948 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222119    4948 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222121    4948 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222124    4948 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222128    4948 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222131    4948 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:52.238056 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222134    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222137    4948 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222140    4948 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222142    4948 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222145    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222147    4948 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222150    4948 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222152    4948 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222155    4948 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222157    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222160    4948 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222163    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222166    4948 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222168    4948 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222172    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222174    4948 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222177    4948 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222179    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222182    4948 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222185    4948 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:52.238613 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222187    4948 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222190    4948 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222192    4948 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222195    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222198    4948 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222200    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222203    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222205    4948 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222208    4948 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222210    4948 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222214    4948 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222217    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222220    4948 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222223    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222225    4948 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222228    4948 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222230    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222234    4948 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:52.239109 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222237    4948 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222240    4948 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222243    4948 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222246    4948 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222249    4948 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222252    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222255    4948 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222258    4948 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222261    4948 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222263    4948 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222266    4948 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222268    4948 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222271    4948 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222274    4948 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222276    4948 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:52.222279    4948 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.222332    4948 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.223274    4948 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.223319    4948 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 20:38:52.239608 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.223525    4948 server.go:1014] "Starting client certificate rotation"
Oct 30 20:38:52.240139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.223668    4948 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:38:52.240139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.223719    4948 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 20:33:11 +0000 UTC" deadline="2028-04-26 14:00:45.428662353 +0000 UTC"
Oct 30 20:38:52.240139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.223755    4948 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13049h21m53.204910206s"
Oct 30 20:38:52.240139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.224048    4948 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:38:52.240139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.225168    4948 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:38:52.240139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.226335    4948 log.go:25] "Validated CRI v1 runtime API"
Oct 30 20:38:52.240139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.228035    4948 log.go:25] "Validated CRI v1 image API"
Oct 30 20:38:52.240139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.228732    4948 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 20:38:52.240139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.230536    4948 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7b15490f-0794-4b40-87a1-85d86dad1b34:/dev/nvme0n1p4 f9a7aecc-6351-42ec-833b-0b6d4ae06089:/dev/nvme0n1p3]
Oct 30 20:38:52.240569 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.230556    4948 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/03e1c06362e3dd7808db1f2e3c0d6b9e5b60fa38bf20da3321a8d430d304d163/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/03e1c06362e3dd7808db1f2e3c0d6b9e5b60fa38bf20da3321a8d430d304d163/userdata/shm major:0 minor:294 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/17eb869a7aeffaa252c4ab447a6dbeb1fb3ee857526d91a15a89aedb81ba19d9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/17eb869a7aeffaa252c4ab447a6dbeb1fb3ee857526d91a15a89aedb81ba19d9/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2303a31e05104c3a9c1f779c27193bde50b235185e1f698154305848ea8de0e2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2303a31e05104c3a9c1f779c27193bde50b235185e1f698154305848ea8de0e2/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2a32c8d03f6550f6689eaac809b0765b6767c20be6db368aecd22b1c8a75b349/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2a32c8d03f6550f6689eaac809b0765b6767c20be6db368aecd22b1c8a75b349/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/49a6b9a89803a6c4afd76d670e192c11e3a23f0a489ac3644318bb85a37ddedf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/49a6b9a89803a6c4afd76d670e192c11e3a23f0a489ac3644318bb85a37ddedf/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4a06cccd8363eb976ad80cdab3524fef2f280c144292e32dbb2a44e4460cf5a0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4a06cccd8363eb976ad80cdab3524fef2f280c144292e32dbb2a44e4460cf5a0/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/579717f015c674d784f496845ac7acf50ff658304e5946c01b0ac7a8d03d7d1c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/579717f015c674d784f496845ac7acf50ff658304e5946c01b0ac7a8d03d7d1c/userdata/shm major:0 minor:85 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/597cfae78c6505f4046a2c02ed85c0466937a74bcf6c2a785f5c554aeb8db47a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/597cfae78c6505f4046a2c02ed85c0466937a74bcf6c2a785f5c554aeb8db47a/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/63b63a04ff0364b1069ab2c6e93940e4be8850e888e6b4ff1d5c79e32b629874/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/63b63a04ff0364b1069ab2c6e93940e4be8850e888e6b4ff1d5c79e32b629874/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8560913ce269f1d07e18c091452a0a2e14656f00203bf3280d76eaa3c6c6bf3b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8560913ce269f1d07e18c091452a0a2e14656f00203bf3280d76eaa3c6c6bf3b/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8885b3e0bc755f3c351c4c0612f02d4ba533ef40b9bcdd1c6aebc0e48b8bcac8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8885b3e0bc755f3c351c4c0612f02d4ba533ef40b9bcdd1c6aebc0e48b8bcac8/userdata/shm major:0 minor:70 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8a82aecbf31cc1d034b831436afe9536b72319045a83e37c060b0cac3183e5b7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8a82aecbf31cc1d034b831436afe9536b72319045a83e37c060b0cac3183e5b7/userdata/shm major:0 minor:77 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8e73ccc5c3c664c0cf1118b6ac6a9cbc9e35495e188726edc703d01c5396c456/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8e73ccc5c3c664c0cf1118b6ac6a9cbc9e35495e188726edc703d01c5396c456/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9768a32130d2b00158440282b8dbb987743b18c902da71fc1fc6975c1d9c8d9e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9768a32130d2b00158440282b8dbb987743b18c902da71fc1fc6975c1d9c8d9e/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9ad382e3d5d01e9b5eb6c57ba0572504c123d93ef5326cebf97c9a16c629f8dc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9ad382e3d5d01e9b5eb6c57ba0572504c123d93ef5326cebf97c9a16c629f8dc/userdata/shm major:0 minor:245 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a4d5362266ab2212469a899626f8f64302ff00821e197d500eae72bd69b2a1fc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a4d5362266ab2212469a899626f8f64302ff00821e197d500eae72bd69b2a1fc/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b37c02572e3aa5c5eb7774ce952dfd2a84d29c5bcc98fd5a7e661bf34c66f1e3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b37c02572e3aa5c5eb7774ce952dfd2a84d29c5bcc98fd5a7e661bf34c66f1e3/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cef38ab9175d6ee2ef1312e86d6385df072e4086052999a485a944e24cf8b4a2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cef38ab9175d6ee2ef1312e86d6385df072e4086052999a485a944e24cf8b4a2/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d1a58b702b45e2f5ebac5bb7357aa4d726374ff9734e309c593a23ce03859c8b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d1a58b702b45e2f5ebac5bb7357aa4d726374ff9734e309c593a23ce03859c8b/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e1b5aaf381ebaa82a549d5264b9eefef07db6161dfaa63435c49063ee139de21/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e1b5aaf381ebaa82a549d5264b9eefef07db6161dfaa63435c49063ee139de21/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e5acf9f9d41e2b99f41fdb1f8e26624d5c17ee0caee498d1ecf395ee5b7f3fc1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e5acf9f9d41e2b99f41fdb1f8e26624d5c17ee0caee498d1ecf395ee5b7f3fc1/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f4e6295e91d8bd1ec31f9910dbc37f59be31ade334afb64407d712fa7867a867/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f4e6295e91d8bd1ec31f9910dbc37f59be31ade334afb64407d712fa7867a867/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fd8f1b9a24905e5bc02c07df1384a12eccddf943c0175509cb18848efd0c7100/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fd8f1b9a24905e5bc02c07df1384a12eccddf943c0175509cb18848efd0c7100/userdata/shm major:0 minor:316 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/04f91be3-79d3-4f15-a7ba-f2d0bb249e02/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/04f91be3-79d3-4f15-a7ba-f2d0bb249e02/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/04f91be3-79d3-4f15-a7ba-f2d0bb249e02/volumes/kubernetes.io~projected/kube-api-access-9mjsj:{mountpoint:/var/lib/kubelet/pods/04f91be3-79d3-4f15-a7ba-f2d0bb249e02/volumes/kubernetes.io~projected/kube-api-access-9mjsj major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/04f91be3-79d3-4f15-a7ba-f2d0bb249e02/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/04f91be3-79d3-4f15-a7ba-f2d0bb249e02/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/04f91be3-79d3-4f15-a7ba-f2d0bb249e02/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/04f91be3-79d3-4f15-a7ba-f2d0bb249e02/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06028e29-e135-48d5-aa5d-2c625009150d/volumes/kubernetes.io~projected/kube-api-access-f2v6p:{mountpoint:/var/lib/kubelet/pods/06028e29-e135-48d5-aa5d-2c625009150d/volumes/kubernetes.io~projected/kube-api-access-f2v6p major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/21b1d440-8b5c-4e0b-b3bf-e74befdce48e/volumes/kubernetes.io~projected/kube-api-access-4z9tp:{mountpoint:/var/lib/kubelet/pods/21b1d440-8b5c-4e0b-b3bf-e74befdce48e/volumes/kubernetes.io~projected/kube-api-access-4z9tp major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/21b1d440-8b5c-4e0b-b3bf-e74befdce48e/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/21b1d440-8b5c-4e0b-b3bf-e74befdce48e/volumes/kubernetes.io~secret/serving-cert major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d040316-e799-40d0-b5ee-2a4351ca99bd/volumes/kubernetes.io~projected/kube-api-access-p6xjn:{mountpoint:/var/lib/kubelet/pods/2d040316-e799-40d0-b5ee-2a4351ca99bd/volumes/kubernetes.io~projected/kube-api-access-p6xjn major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d040316-e799-40d0-b5ee-2a4351ca99bd/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/2d040316-e799-40d0-b5ee-2a4351ca99bd/volumes/kubernetes.io~secret/cert major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34e89d20-b285-4246-8184-9fe736a2c6fb/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/34e89d20-b285-4246-8184-9fe736a2c6fb/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34f5534a-5450-43a0-8d78-bc7e362bcfa9/volumes/kubernetes.io~projected/kube-api-access-jt972:{mountpoint:/var/lib/kubelet/pods/34f5534a-5450-43a0-8d78-bc7e362bcfa9/volumes/kubernetes.io~projected/kube-api-access-jt972 major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/571e6927-684b-4d97-b9ab-4d2581d5235a/volumes/kubernetes.io~projected/kube-api-access-7tk25:{mountpoint:/var/lib/kubelet/pods/571e6927-684b-4d97-b9ab-4d2581d5235a/volumes/kubernetes.io~projected/kube-api-access-7tk25 major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/75581bb4-9213-4894-ad60-5cbe03c4ff6c/volumes/kubernetes.io~projected/kube-api-access-l6w9q:{mountpoint:/var/lib/kubelet/pods/75581bb4-9213-4894-ad60-5cbe03c4ff6c/volumes/kubernetes.io~projected/kube-api-access-l6w9q major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e9d8fb4-c43e-4973-b67b-7cca18f00408/volumes/kubernetes.io~projected/kube-api-access-v6xh6:{mountpoint:/var/lib/kubelet/pods/7e9d8fb4-c43e-4973-b67b-7cca18f00408/volumes/kubernetes.io~projected/kube-api-access-v6xh6 major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/86386c5c-e63e-4a97-a58e-ee79814a585f/volumes/kubernetes.io~projected/kube-api-access-97prz:{mountpoint:/var/lib/kubelet/pods/86386c5c-e63e-4a97-a58e-ee79814a585f/volumes/kubernetes.io~projected/kube-api-access-97prz major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/86ced41b-f67d-4a69-9c48-81be43c75698/volumes/kubernetes.io~projected/kube-api-access-ztctx:{mountpoint:/var/lib/kubelet/pods/86ced41b-f67d-4a69-9c48-81be43c75698/volumes/kubernetes.io~projected/kube-api-access-ztctx major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/86ced41b-f67d-4a69-9c48-81be43c75698/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/86ced41b-f67d-4a69-9c48-81be43c75698/volumes/kubernetes.io~secret/default-certificate major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/86ced41b-f67d-4a69-9c48-81be43c75698/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/86ced41b-f67d-4a69-9c48-81be43c75698/volumes/kubernetes.io~secret/stats-auth major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87b38c08-ae1d-4961-bd80-f0198dec4a22/volumes/kubernetes.io~projected/kube-api-access-4psg6:{mountpoint:/var/lib/kubelet/pods/87b38c08-ae1d-4961-bd80-f0198dec4a22/volumes/kubernetes.io~projected/kube-api-access-4psg6 major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c/volumes/kubernetes.io~projected/kube-api-access-wz6t9:{mountpoint:/var/lib/kubelet/pods/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c/volumes/kubernetes.io~projected/kube-api-access-wz6t9 major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/90198fcb-a25b-4437-965b-750ede2da138/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/90198fcb-a25b-4437-965b-750ede2da138/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/90198fcb-a25b-4437-965b-750ede2da138/volumes/kubernetes.io~projected/kube-api-access-l45ml:{mountpoint:/var/lib/kubelet/pods/90198fcb-a25b-4437-965b-750ede2da138/volumes/kubernetes.io~projected/kube-api-access-l45ml major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/90198fcb-a25b-4437-965b-750ede2da138/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/90198fcb-a25b-4437-965b-750ede2da138/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/90198fcb-a25b-4437-965b-750ede2da138/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/90198fcb-a25b-4437-965b-750ede2da138/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93430674-7eab-453f-a278-c8d352572441/volumes/kubernetes.io~projected/kube-api-access-5wwsv:{mountpoint:/var/lib/kubelet/pods/93430674-7eab-453f-a278-c8d352572441/volumes/kubernetes.io~projected/kube-api-access-5wwsv major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/990e57a8-4ba2-43be-8108-2bcf3b8da004/volumes/kubernetes.io~projected/kube-api-access-nsx2t:{mountpoint:/var/lib/kubelet/pods/990e57a8-4ba2-43be-8108-2bcf3b8da004/volumes/kubernetes.io~projected/kube-api-access-nsx2t major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9d262282-6f9c-4945-959d-81e9a9a12392/volumes/kubernetes.io~projected/kube-api-access-6rk9l:{mountpoint:/var/lib/kubelet/pods/9d262282-6f9c-4945-959d-81e9a9a12392/volumes/kubernetes.io~projected/kube-api-access-6rk9l major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9d262282-6f9c-4945-959d-81e9a9a12392/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/9d262282-6f9c-4945-959d-81e9a9a12392/volumes/kubernetes.io~secret/serving-cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a531c68c-5ab5-408a-ae30-640a1bc4c8ab/volumes/kubernetes.io~projected/kube-api-access-mt4gk:{mountpoint:/var/lib/kubelet/pods/a531c68c-5ab5-408a-ae30-640a1bc4c8ab/volumes/kubernetes.io~projected/kube-api-access-mt4gk major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c/volumes/kubernetes.io~projected/kube-api-access-npfcb:{mountpoint:/var/lib/kubelet/pods/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c/volumes/kubernetes.io~projected/kube-api-access-npfcb major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c/volumes/kubernetes.io~secret/serving-cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b2a12cab-f546-4344-8460-3f967e181eeb/volumes/kubernetes.io~projected/kube-api-access-89r9b:{mountpoint:/var/lib/kubelet/pods/b2a12cab-f546-4344-8460-3f967e181eeb/volumes/kubernetes.io~projected/kube-api-access-89r9b major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b2a12cab-f546-4344-8460-3f967e181eeb/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/b2a12cab-f546-4344-8460-3f967e181eeb/volumes/kubernetes.io~secret/serving-cert major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b502ddfa-b655-45b6-9b0f-e936f85a0fcb/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/b502ddfa-b655-45b6-9b0f-e936f85a0fcb/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b502ddfa-b655-45b6-9b0f-e936f85a0fcb/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/b502ddfa-b655-45b6-9b0f-e936f85a0fcb/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b502ddfa-b655-45b6-9b0f-e936f85a0fcb/volumes/kubernetes.io~projected/kube-api-access-nbtq7:{mountpoint:/var/lib/kubelet/pods/b502ddfa-b655-45b6-9b0f-e936f85a0fcb/volumes/kubernetes.io~projected/kube-api-access-nbtq7 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c9a4a383-c9b9-4475-b22e-d336d1a35422/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/c9a4a383-c9b9-4475-b22e-d336d1a35422/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf3347a5-26a7-4708-abb3-e3a39308f782/volumes/kubernetes.io~projected/kube-api-access-dvkf4:{mountpoint:/var/lib/kubelet/pods/cf3347a5-26a7-4708-abb3-e3a39308f782/volumes/kubernetes.io~projected/kube-api-access-dvkf4 major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d204b46f-c6a4-440f-8078-ce647d423f59/volumes/kubernetes.io~projected/kube-api-access-nzclf:{mountpoint:/var/lib/kubelet/pods/d204b46f-c6a4-440f-8078-ce647d423f59/volumes/kubernetes.io~projected/kube-api-access-nzclf major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0/volumes/kubernetes.io~projected/kube-api-access-slmhq:{mountpoint:/var/lib/kubelet/pods/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0/volumes/kubernetes.io~projected/kube-api-access-slmhq major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dda1e37e-2f98-46b0-8ad9-632d308a5744/volumes/kubernetes.io~projected/kube-api-access-wmxmn:{mountpoint:/var/lib/kubelet/pods/dda1e37e-2f98-46b0-8ad9-632d308a5744/volumes/kubernetes.io~projected/kube-api-access-wmxmn major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e9ba6324-4a54-40b9-8c8c-b2dee0510797/volumes/kubernetes.io~projected/kube-api-access-lzwtl:{mountpoint:/var/lib/kubelet/pods/e9ba6324-4a54-40b9-8c8c-b2dee0510797/volumes/kubernetes.io~projected/kube-api-access-lzwtl major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f0f30507-57cb-4145-bd0c-f44b3698d7ab/volumes/kubernetes.io~projected/kube-api-access-rv82j:{mountpoint:/var/lib/kubelet/pods/f0f30507-57cb-4145-bd0c-f44b3698d7ab/volumes/kubernetes.io~projected/kube-api-access-rv82j major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f264b5d9-bc95-4e78-b399-43e8148c8768/volumes/kubernetes.io~projected/kube-api-access-ll7j5:{mountpoint:/var/lib/kubelet/pods/f264b5d9-bc95-4e78-b399-43e8148c8768/volumes/kubernetes.io~projected/kube-api-access-ll7j5 major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f7716064-3190-400e-be69-91ee32a14749/volumes/kubernetes.io~projected/kube-api-access-2kfg8:{mountpoint:/var/lib/kubelet/pods/f7716064-3190-400e-be69-91ee32a14749/volumes/kubernetes.io~projected/kube-api-access-2kfg8 major:0 minor:58 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/eda6986e9682d538138aae1b444d5c198733c4c775cb8efb76da1e9fc6475dc0/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/4da91cbbf89e2a6bb9fb78ff1ca31911e8382dda0864c4fc5248491590cb4b10/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/aa5ec0fff909fe89f6d456ce10faf631973ca9ed9d80621e73096ff874513849/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/1cda9a433facffbb11cf65a11774d4e38fdff37da28edd123d5a8530abd53e69/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-111:{mountpoint:/var/lib/containers/storage/overlay/07e228d6c370eb31108ce0f5c02cca005a13c3da1848a616913503ce519da020/merged major:0 minor:111 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/27ed6dcf33ed974782f11a6e8cec9542eec89edcf745454b4d0de78a0f39118d/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/4a317e3189ea3ec69568df6cd83e2464bf6491c7c0594902079bca1a96fc1eb5/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/a6234672f5db69ae2cc51bf5abe7a4d00e148fb62d41187b032101953fe194d1/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/be67f2e9e420f75139ec061c63a5030518b315fd6e015fc0bb3be3599e845f18/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/9c6d351d5815f5f03b59ae5411e672b3c54111f7997e94be7d5ee758b83e5122/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/3aebb84d4437c3fdc5920e12dda0a958b95309792a57b184b5346973e0007830/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/7c9cbdcfa364d9515e907948968cc5093a1d8b2fc5706aa0f3688c1158d9ae78/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/c3bd5f32d7cd765f7bfb2715487b94d2822c13b0ee4509c801a6cf15dd5bd947/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/cef74e1d61fbeb3216430462cc5bbdf3175e77ae0e148197db3db2b0efb36f11/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/ea0d45633c69366dfe64941543cac310dc78e12335cf01509670fe922b657810/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/a6ab782b6e509b040848a6111fc006345b354760e874809b750d71799d1ac2e2/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/80aac6d638c001d57a6e7bc02b52818a3e3b5401eb3e4d91c4c35b28a75d0452/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/d890f2b5fd6444d63e76077273a0d5435d4d89568100482169e233653b81698c/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/91bd9fd146dda84328d3c13dda283536d880fee726fcab9e71326b5dd689f24c/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/ae5fb0bc74b12a58f9d110d9c858177a179166b2fb5f0c569bf03aed4de3edb6/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/d0230adc341c6fed0ad23669abea37d08e202d2cb9b0963cf2a283510525c02e/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/2d202f026110861c7b4b6be4fbf77ebc0ed66efc8a95ea45fb6cc726085fd78a/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/d24673100e16fe57a7db610419f3a943511889acbb7e8700c2d8736a5e1e4c0f/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/d880e4b639f7ebf2294c3950683f3a88393e08dcfaead9cf73aed45a4bbfb79e/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/ad2fd30111cad43a94ce849e3f30796d4ad9fdda41cc969ddf13e0a2c248bccd/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/e7a28c853a7747d4a01bbd2a76b1e4c3b465a181306df1fbb1e625d8ffc0a86f/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/4016138117e6aa63022f697937de3edd2fe336a1ff336be79e1da6416d42dbbc/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/dd1adcf572e9f154d474c86f4731e874d0ed9265aa8601e161c8ea2d469b9b70/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/526b45cc8f5ec07e6f63855d0eaf60c07c52c38f057ac98915b030054e839755/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/b44f317a1d210c59a2558bc4d30cfd901d2f8b701e58966ef2ffe56931700d3d/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-265:{mountpoint:/var/lib/containers/storage/overlay/ffd9cfefd91c7ab72a7666fdbc24d499a7d38ea558b9f59093aa94b8c8a85db8/merged major:0 minor:265 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/c913be6ae4522b34aa13fea84c493127947f9d57101759c72fd1d5dfe4652d9e/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/fc814d53eec50fe85c68a0a152d54da707accb619baba54c664d9b5fd28bbba0/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-280:{mountpoint:/var/lib/containers/storage/overlay/42f1331dcefb5f9cab182f94f2aadf369ca42fb13205225b2204cfe9f0e76f1b/merged major:0 minor:280 fsType:overlay blockSize:0} overlay_0-282:{mountpoint:/var/lib/containers/storage/overlay/f4f1d76454a6b0acc33a43a24582eeae1ddd1317efa76425de8a3ab0da8a8725/merged major:0 minor:282 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/64616cde6a5305f11a381e0e67b6b63860d18b2b8da161e574135a239c4b957c/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/c96ff5201c8628eeffda6c6c86aa7815ac8a42b6956e09a1861fe3d829decb10/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/487e7e7d33eadbfe53291c931ea29516ed7ed95ef1f526eddda7dd86c7456226/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/22160a659952227574c0c6b42ef5efdd733545dd0d3cf6d36130a2a2f8e115fe/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/c06b4b0945be3a5b5a322e63d048c8ce216d4b1bed56ac1889f32b107121569c/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-308:{mountpoint:/var/lib/containers/storage/overlay/b85058563b7f57e0516245cab959ae5587413237d6de6e9f2c4b0d84833e3ff1/merged major:0 minor:308 fsType:overlay blockSize:0} overlay_0-330:{mountpoint:/var/lib/containers/storage/overlay/1b6b25dc5884730644f94d70dc2fe7f5615de4b05f47a99ea9d3d0dad42450a6/merged major:0 minor:330 fsType:overlay blockSize:0} overlay_0-332:{mountpoint:/var/lib/containers/storage/overlay/8e64d6b0c2717d53ee79806e6981e1f4d8c7a40cd48423e3eda2a97e07c3c888/merged major:0 minor:332 fsType:overlay blockSize:0} overlay_0-338:{mountpoint:/var/lib/containers/storage/overlay/14056718452c2e09e8c58636573a0c15d5c1228963526c39f90e6f92bbb72aaa/merged major:0 minor:338 fsType:overlay blockSize:0} overlay_0-340:{mountpoint:/var/lib/containers/storage/overlay/63f126e5faded502af76884865e86a0356e48d1f0dd41170406281534f8a4c23/merged major:0 minor:340 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/3fe42c4f62606cc425aa9f80b3cc192f11ceb4560e76a399ebd2c3188079e076/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/9d7db2d6c786a4d6065ceda1e5f59580cf9e496edd3e90dae7cd2ce09f88e2a9/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/5fa23f2f93039b697eeaa3abba0f5a3ad9d981691f747fd96370ddb3ccc90044/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/feac07ae86b437b77937f1c764e10082268c0cd33c82b0113e1925456be989da/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/e8ae780f2878bce8c619837ea2d4324668cb5c7f2108b0944023d267914bfdcc/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/e475d451390d6431b8a8c05e06002a34c172f84f0704ea90c35068b90ecdd847/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/070c2c2d914ed5c8062e2f99c4b8f6ae702be248c08bbbc7e252013416813111/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/84beecab9cd575ffa89dd666ac1d93055613299affce7879e575600e8f1c0a3f/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/5170f4a8b85296344ce4377a7180d828662498c83869864876e93d59c552e535/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/35906c64d72fdba5c8dd5b476aa247f0634143a938e73ea3862f7934e86f9cd4/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/557eb5b9961610be5eaf88e057be33eeeea6620e4dbbf8a9bc736fcee1d751f5/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.238771    4948 manager.go:217] Machine: {Timestamp:2026-10-30 20:38:52.23829414 +0000 UTC m=+0.057806119 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100338 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b66d8beaa53ec1b24cdbd1b5f53d1 SystemUUID:ec2b66d8-beaa-53ec-1b24-cdbd1b5f53d1 BootID:124ff9b4-e197-40e1-9d84-a9ced9e25f1c Filesystems:[{Device:/var/lib/kubelet/pods/c9a4a383-c9b9-4475-b22e-d336d1a35422/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c/volumes/kubernetes.io~projected/kube-api-access-npfcb DeviceMajor:0 DeviceMinor:208 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-308 DeviceMajor:0 DeviceMinor:308 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cef38ab9175d6ee2ef1312e86d6385df072e4086052999a485a944e24cf8b4a2/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:201 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/990e57a8-4ba2-43be-8108-2bcf3b8da004/volumes/kubernetes.io~projected/kube-api-access-nsx2t DeviceMajor:0 DeviceMinor:205 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b2a12cab-f546-4344-8460-3f967e181eeb/volumes/kubernetes.io~projected/kube-api-access-89r9b DeviceMajor:0 DeviceMinor:206 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fd8f1b9a24905e5bc02c07df1384a12eccddf943c0175509cb18848efd0c7100/userdata/shm DeviceMajor:0 DeviceMinor:316 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/f7716064-3190-400e-be69-91ee32a14749/volumes/kubernetes.io~projected/kube-api-access-2kfg8 DeviceMajor:0 DeviceMinor:58 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9ad382e3d5d01e9b5eb6c57ba0572504c123d93ef5326cebf97c9a16c629f8dc/userdata/shm DeviceMajor:0 DeviceMinor:245 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/75581bb4-9213-4894-ad60-5cbe03c4ff6c/volumes/kubernetes.io~projected/kube-api-access-l6w9q DeviceMajor:0 DeviceMinor:221 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c/volumes/kubernetes.io~projected/kube-api-access-wz6t9 DeviceMajor:0 DeviceMinor:61 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-111 DeviceMajor:0 DeviceMinor:111 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/90198fcb-a25b-4437-965b-750ede2da138/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:217 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b2a12cab-f546-4344-8460-3f967e181eeb/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:202 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/34f5534a-5450-43a0-8d78-bc7e362bcfa9/volumes/kubernetes.io~projected/kube-api-access-jt972 DeviceMajor:0 DeviceMinor:60 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a4d5362266ab2212469a899626f8f64302ff00821e197d500eae72bd69b2a1fc/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d1a58b702b45e2f5ebac5bb7357aa4d726374ff9734e309c593a23ce03859c8b/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e5acf9f9d41e2b99f41fdb1f8e26624d5c17ee0caee498d1ecf395ee5b7f3fc1/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b502ddfa-b655-45b6-9b0f-e936f85a0fcb/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:56 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/04f91be3-79d3-4f15-a7ba-f2d0bb249e02/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:222 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-280 DeviceMajor:0 DeviceMinor:280 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b37c02572e3aa5c5eb7774ce952dfd2a84d29c5bcc98fd5a7e661bf34c66f1e3/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/597cfae78c6505f4046a2c02ed85c0466937a74bcf6c2a785f5c554aeb8db47a/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/571e6927-684b-4d97-b9ab-4d2581d5235a/volumes/kubernetes.io~projected/kube-api-access-7tk25 DeviceMajor:0 DeviceMinor:66 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/06028e29-e135-48d5-aa5d-2c625009150d/volumes/kubernetes.io~projected/kube-api-access-f2v6p DeviceMajor:0 DeviceMinor:67 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8885b3e0bc755f3c351c4c0612f02d4ba533ef40b9bcdd1c6aebc0e48b8bcac8/userdata/shm DeviceMajor:0 DeviceMinor:70 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8a82aecbf31cc1d034b831436afe9536b72319045a83e37c060b0cac3183e5b7/userdata/shm DeviceMajor:0 DeviceMinor:77 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:62 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0/volumes/kubernetes.io~projected/kube-api-access-slmhq DeviceMajor:0 DeviceMinor:64 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/90198fcb-a25b-4437-965b-750ede2da138/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:218 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2a32c8d03f6550f6689eaac809b0765b6767c20be6db368aecd22b1c8a75b349/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-340 DeviceMajor:0 DeviceMinor:340 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d204b46f-c6a4-440f-8078-ce647d423f59/volumes/kubernetes.io~projected/kube-api-access-nzclf DeviceMajor:0 DeviceMinor:227 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/17eb869a7aeffaa252c4ab447a6dbeb1fb3ee857526d91a15a89aedb81ba19d9/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/04f91be3-79d3-4f15-a7ba-f2d0bb249e02/volumes/kubernetes.io~projected/kube-api-access-9mjsj DeviceMajor:0 DeviceMinor:220 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9d262282-6f9c-4945-959d-81e9a9a12392/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:45 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/04f91be3-79d3-4f15-a7ba-f2d0bb249e02/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:215 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-265 DeviceMajor:0 DeviceMinor:265 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f4e6295e91d8bd1ec31f9910dbc37f59be31ade334afb64407d712fa7867a867/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/63b63a04ff0364b1069ab2c6e93940e4be8850e888e6b4ff1d5c79e32b629874/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/90198fcb-a25b-4437-965b-750ede2da138/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:212 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2d040316-e799-40d0-b5ee-2a4351ca99bd/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:214 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/34e89d20-b285-4246-8184-9fe736a2c6fb/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:288 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/86ced41b-f67d-4a69-9c48-81be43c75698/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:213 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e1b5aaf381ebaa82a549d5264b9eefef07db6161dfaa63435c49063ee139de21/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/579717f015c674d784f496845ac7acf50ff658304e5946c01b0ac7a8d03d7d1c/userdata/shm DeviceMajor:0 DeviceMinor:85 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/e9ba6324-4a54-40b9-8c8c-b2dee0510797/volumes/kubernetes.io~projected/kube-api-access-lzwtl DeviceMajor:0 DeviceMinor:203 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/cf3347a5-26a7-4708-abb3-e3a39308f782/volumes/kubernetes.io~projected/kube-api-access-dvkf4 DeviceMajor:0 DeviceMinor:293 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-332 DeviceMajor:0 DeviceMinor:332 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f0f30507-57cb-4145-bd0c-f44b3698d7ab/volumes/kubernetes.io~projected/kube-api-access-rv82j DeviceMajor:0 DeviceMinor:65 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/dda1e37e-2f98-46b0-8ad9-632d308a5744/volumes/kubernetes.io~projected/kube-api-access-wmxmn DeviceMajor:0 DeviceMinor:219 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4a06cccd8363eb976ad80cdab3524fef2f280c144292e32dbb2a44e4460cf5a0/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8e73ccc5c3c664c0cf1118b6ac6a9cbc9e35495e188726edc703d01c5396c456/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-282 DeviceMajor:0 DeviceMinor:282 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-330 DeviceMajor:0 DeviceMinor:330 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9d262282-6f9c-4945-959d-81e9a9a12392/volumes/kubernetes.io~projected/kube-api-access-6rk9l DeviceMajor:0 DeviceMinor:207 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/04f91be3-79d3-4f15-a7ba-f2d0bb249e02/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:211 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2d040316-e799-40d0-b5ee-2a4351ca99bd/volumes/kubernetes.io~projected/kube-api-access-p6xjn DeviceMajor:0 DeviceMinor:224 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-338 DeviceMajor:0 DeviceMinor:338 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b502ddfa-b655-45b6-9b0f-e936f85a0fcb/volumes/kubernetes.io~projected/kube-api-access-nbtq7 DeviceMajor:0 DeviceMinor:59 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9768a32130d2b00158440282b8dbb987743b18c902da71fc1fc6975c1d9c8d9e/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/86386c5c-e63e-4a97-a58e-ee79814a585f/volumes/kubernetes.io~projected/kube-api-access-97prz DeviceMajor:0 DeviceMinor:210 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8560913ce269f1d07e18c091452a0a2e14656f00203bf3280d76eaa3c6c6bf3b/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f264b5d9-bc95-4e78-b399-43e8148c8768/volumes/kubernetes.io~projected/kube-api-access-ll7j5 DeviceMajor:0 DeviceMinor:209 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/90198fcb-a25b-4437-965b-750ede2da138/volumes/kubernetes.io~projected/kube-api-access-l45ml DeviceMajor:0 DeviceMinor:223 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/03e1c06362e3dd7808db1f2e3c0d6b9e5b60fa38bf20da3321a8d430d304d163/userdata/shm DeviceMajor:0 DeviceMinor:294 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/86ced41b-f67d-4a69-9c48-81be43c75698/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:216 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/a531c68c-5ab5-408a-ae30-640a1bc4c8ab/volumes/kubernetes.io~projected/kube-api-access-mt4gk DeviceMajor:0 DeviceMinor:315 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b502ddfa-b655-45b6-9b0f-e936f85a0fcb/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/21b1d440-8b5c-4e0b-b3bf-e74befdce48e/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:197 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/21b1d440-8b5c-4e0b-b3bf-e74befdce48e/volumes/kubernetes.io~projected/kube-api-access-4z9tp DeviceMajor:0 DeviceMinor:204 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/87b38c08-ae1d-4961-bd80-f0198dec4a22/volumes/kubernetes.io~projected/kube-api-access-4psg6 DeviceMajor:0 DeviceMinor:63 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/49a6b9a89803a6c4afd76d670e192c11e3a23f0a489ac3644318bb85a37ddedf/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/86ced41b-f67d-4a69-9c48-81be43c75698/volumes/kubernetes.io~projected/kube-api-access-ztctx DeviceMajor:0 DeviceMinor:225 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/7e9d8fb4-c43e-4973-b67b-7cca18f00408/volumes/kubernetes.io~projected/kube-api-access-v6xh6 DeviceMajor:0 DeviceMinor:226 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2303a31e05104c3a9c1f779c27193bde50b235185e1f698154305848ea8de0e2/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/93430674-7eab-453f-a278-c8d352572441/volumes/kubernetes.io~projected/kube-api-access-5wwsv DeviceMajor:0 DeviceMinor:310 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:03e1c06362e3dd7 MacAddress:da:d5:63:bf:fd:e2 Speed:10000 Mtu:8901} {Name:17eb869a7aeffaa MacAddress:26:a3:66:9a:b2:3f Speed:10000 Mtu:8901} {Name:2303a31e05104c3 MacAddress:06:d7:49:99:c3:2a Speed:10000 Mtu:8901} {Name:2a32c8d03f6550f MacAddress:da:bc:8e:eb:f1:3a Speed:10000 Mtu:8901} {Name:4a06cccd8363eb9 MacAddress:12:8e:fe:a3:05:eb Speed:10000 Mtu:8901} {Name:597cfae78c6505f MacAddress:86:6d:01:2a:8f:cb Speed:10000 Mtu:8901} {Name:8560913ce269f1d MacAddress:52:47:10:a2:91:2b Speed:10000 Mtu:8901} {Name:8e73ccc5c3c664c MacAddress:92:2e:ec:57:74:05 Speed:10000 Mtu:8901} {Name:9ad382e3d5d01e9 MacAddress:62:ef:e4:9b:fb:d9 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:c9:cb:15:35 Speed:0 Mtu:9001} {Name:br-int MacAddress:be:33:f5:b5:be:95 Speed:0 Mtu:8901} {Name:cef38ab9175d6ee MacAddress:aa:3b:58:a8:4a:f1 Speed:10000 Mtu:8901} {Name:d1a58b702b45e2f MacAddress:e6:6e:4f:87:25:a6 Speed:10000 Mtu:8901} {Name:e1b5aaf381ebaa8 MacAddress:8e:c7:f0:db:c9:f7 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:c9:cb:15:35 Speed:0 Mtu:9001} {Name:fd8f1b9a24905e5 MacAddress:1e:99:57:cc:7c:93 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:ee:3d:40:b0:19:4b Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:de:aa:d3:3b:77:f3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.239104    4948 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.239147    4948 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.239429    4948 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.239456    4948 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-183.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.239578    4948 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.239585    4948 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.239596    4948 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.239616    4948 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.239635    4948 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.239784    4948 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.239892    4948 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.239924    4948 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.239934    4948 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.239944    4948 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.239953    4948 kubelet.go:405] "Adding apiserver pod source"
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.239961    4948 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.240665    4948 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 20:38:52.240891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.240675    4948 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:38:52.241591 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.241160    4948 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 20:38:52.243333 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243317    4948 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 20:38:52.243333 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243332    4948 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:38:52.243527 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243436    4948 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 20:38:52.243635 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243623    4948 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 20:38:52.243673 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243654    4948 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 20:38:52.243776 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243766    4948 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 20:38:52.243809 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243782    4948 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 20:38:52.243809 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243787    4948 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 20:38:52.243809 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243793    4948 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 20:38:52.243809 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243802    4948 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 20:38:52.243915 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243812    4948 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 20:38:52.243915 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243821    4948 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 20:38:52.243915 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243827    4948 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 20:38:52.243915 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243834    4948 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 20:38:52.243915 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243840    4948 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 20:38:52.243915 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243854    4948 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 20:38:52.243915 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243864    4948 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 20:38:52.243915 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243892    4948 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 20:38:52.243915 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.243901    4948 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 20:38:52.247575 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.247560    4948 server.go:1263] "Started kubelet"
Oct 30 20:38:52.247714 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.247660    4948 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 20:38:52.247947 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.247770    4948 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 20:38:52.247947 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.247627    4948 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 20:38:52.248150 ip-10-0-142-183 systemd[1]: Started Kubernetes Kubelet.
Oct 30 20:38:52.249755 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.249225    4948 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 20:38:52.249755 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.249551    4948 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 20:38:52.255272 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.254173    4948 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 20:38:52.255272 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.254192    4948 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 20:38:52.255272 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.254287    4948 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 20:38:52.255272 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.254297    4948 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 20:38:52.255272 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.254278    4948 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:33:13 +0000 UTC" deadline="2028-05-17 18:43:55.396902585 +0000 UTC"
Oct 30 20:38:52.255272 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.254312    4948 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13558h5m3.142593662s"
Oct 30 20:38:52.255272 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:52.254353    4948 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-183.us-east-2.compute.internal\" not found"
Oct 30 20:38:52.255272 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.254413    4948 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 20:38:52.256397 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.255601    4948 factory.go:55] Registering systemd factory
Oct 30 20:38:52.256397 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.255620    4948 factory.go:223] Registration of the systemd container factory successfully
Oct 30 20:38:52.256644 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256617    4948 factory.go:153] Registering CRI-O factory
Oct 30 20:38:52.256644 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256638    4948 factory.go:223] Registration of the crio container factory successfully
Oct 30 20:38:52.256782 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256694    4948 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 20:38:52.256782 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256717    4948 factory.go:103] Registering Raw factory
Oct 30 20:38:52.256782 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256731    4948 manager.go:1199] Started watching for new ooms in manager
Oct 30 20:38:52.256934 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256878    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0" volumeName="kubernetes.io/secret/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 20:38:52.256934 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256904    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f7716064-3190-400e-be69-91ee32a14749" volumeName="kubernetes.io/projected/f7716064-3190-400e-be69-91ee32a14749-kube-api-access-2kfg8" seLinuxMountContext=""
Oct 30 20:38:52.256934 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256914    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90198fcb-a25b-4437-965b-750ede2da138" volumeName="kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-kube-api-access-l45ml" seLinuxMountContext=""
Oct 30 20:38:52.256934 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256922    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90198fcb-a25b-4437-965b-750ede2da138" volumeName="kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 20:38:52.256934 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256931    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04f91be3-79d3-4f15-a7ba-f2d0bb249e02" volumeName="kubernetes.io/empty-dir/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-ca-trust-extracted" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256938    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90198fcb-a25b-4437-965b-750ede2da138" volumeName="kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-bound-sa-token" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256946    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86ced41b-f67d-4a69-9c48-81be43c75698" volumeName="kubernetes.io/projected/86ced41b-f67d-4a69-9c48-81be43c75698-kube-api-access-ztctx" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256955    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="21b1d440-8b5c-4e0b-b3bf-e74befdce48e" volumeName="kubernetes.io/empty-dir/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-tmp" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256964    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90198fcb-a25b-4437-965b-750ede2da138" volumeName="kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-trusted-ca" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256971    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa1a36c1-6032-42fe-aec6-97d2cc67bc0c" volumeName="kubernetes.io/projected/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-kube-api-access-npfcb" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256979    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dda1e37e-2f98-46b0-8ad9-632d308a5744" volumeName="kubernetes.io/projected/dda1e37e-2f98-46b0-8ad9-632d308a5744-kube-api-access-wmxmn" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256986    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f7716064-3190-400e-be69-91ee32a14749" volumeName="kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.256994    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="571e6927-684b-4d97-b9ab-4d2581d5235a" volumeName="kubernetes.io/empty-dir/571e6927-684b-4d97-b9ab-4d2581d5235a-tmp-dir" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257001    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="571e6927-684b-4d97-b9ab-4d2581d5235a" volumeName="kubernetes.io/projected/571e6927-684b-4d97-b9ab-4d2581d5235a-kube-api-access-7tk25" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257010    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86ced41b-f67d-4a69-9c48-81be43c75698" volumeName="kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-stats-auth" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257016    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9ba6324-4a54-40b9-8c8c-b2dee0510797" volumeName="kubernetes.io/projected/e9ba6324-4a54-40b9-8c8c-b2dee0510797-kube-api-access-lzwtl" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257023    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d262282-6f9c-4945-959d-81e9a9a12392" volumeName="kubernetes.io/configmap/9d262282-6f9c-4945-959d-81e9a9a12392-config" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257031    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2a12cab-f546-4344-8460-3f967e181eeb" volumeName="kubernetes.io/configmap/b2a12cab-f546-4344-8460-3f967e181eeb-config" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257037    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c9a4a383-c9b9-4475-b22e-d336d1a35422" volumeName="kubernetes.io/configmap/c9a4a383-c9b9-4475-b22e-d336d1a35422-konnectivity-ca" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257044    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f7716064-3190-400e-be69-91ee32a14749" volumeName="kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257051    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04f91be3-79d3-4f15-a7ba-f2d0bb249e02" volumeName="kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257058    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="21b1d440-8b5c-4e0b-b3bf-e74befdce48e" volumeName="kubernetes.io/configmap/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-service-ca-bundle" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257065    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e9d8fb4-c43e-4973-b67b-7cca18f00408" volumeName="kubernetes.io/projected/7e9d8fb4-c43e-4973-b67b-7cca18f00408-kube-api-access-v6xh6" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257072    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa1a36c1-6032-42fe-aec6-97d2cc67bc0c" volumeName="kubernetes.io/configmap/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-config" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257079    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b502ddfa-b655-45b6-9b0f-e936f85a0fcb" volumeName="kubernetes.io/empty-dir/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-tuned" seLinuxMountContext=""
Oct 30 20:38:52.257083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257088    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d204b46f-c6a4-440f-8078-ce647d423f59" volumeName="kubernetes.io/configmap/d204b46f-c6a4-440f-8078-ce647d423f59-config-volume" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257095    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d204b46f-c6a4-440f-8078-ce647d423f59" volumeName="kubernetes.io/projected/d204b46f-c6a4-440f-8078-ce647d423f59-kube-api-access-nzclf" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257103    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="990e57a8-4ba2-43be-8108-2bcf3b8da004" volumeName="kubernetes.io/projected/990e57a8-4ba2-43be-8108-2bcf3b8da004-kube-api-access-nsx2t" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257113    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d262282-6f9c-4945-959d-81e9a9a12392" volumeName="kubernetes.io/projected/9d262282-6f9c-4945-959d-81e9a9a12392-kube-api-access-6rk9l" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257121    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="21b1d440-8b5c-4e0b-b3bf-e74befdce48e" volumeName="kubernetes.io/empty-dir/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-snapshots" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257128    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34f5534a-5450-43a0-8d78-bc7e362bcfa9" volumeName="kubernetes.io/projected/34f5534a-5450-43a0-8d78-bc7e362bcfa9-kube-api-access-jt972" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257136    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90198fcb-a25b-4437-965b-750ede2da138" volumeName="kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-installation-pull-secrets" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257143    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c9a4a383-c9b9-4475-b22e-d336d1a35422" volumeName="kubernetes.io/secret/c9a4a383-c9b9-4475-b22e-d336d1a35422-agent-certs" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257163    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87b38c08-ae1d-4961-bd80-f0198dec4a22" volumeName="kubernetes.io/projected/87b38c08-ae1d-4961-bd80-f0198dec4a22-kube-api-access-4psg6" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257172    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90198fcb-a25b-4437-965b-750ede2da138" volumeName="kubernetes.io/empty-dir/90198fcb-a25b-4437-965b-750ede2da138-ca-trust-extracted" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257179    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a531c68c-5ab5-408a-ae30-640a1bc4c8ab" volumeName="kubernetes.io/projected/a531c68c-5ab5-408a-ae30-640a1bc4c8ab-kube-api-access-mt4gk" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257186    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b502ddfa-b655-45b6-9b0f-e936f85a0fcb" volumeName="kubernetes.io/projected/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-kube-api-access-nbtq7" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257194    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0f30507-57cb-4145-bd0c-f44b3698d7ab" volumeName="kubernetes.io/projected/f0f30507-57cb-4145-bd0c-f44b3698d7ab-kube-api-access-rv82j" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257201    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f264b5d9-bc95-4e78-b399-43e8148c8768" volumeName="kubernetes.io/projected/f264b5d9-bc95-4e78-b399-43e8148c8768-kube-api-access-ll7j5" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257208    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f7716064-3190-400e-be69-91ee32a14749" volumeName="kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-cni-binary-copy" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257216    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04f91be3-79d3-4f15-a7ba-f2d0bb249e02" volumeName="kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-kube-api-access-9mjsj" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257224    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93430674-7eab-453f-a278-c8d352572441" volumeName="kubernetes.io/projected/93430674-7eab-453f-a278-c8d352572441-kube-api-access-5wwsv" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257231    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04f91be3-79d3-4f15-a7ba-f2d0bb249e02" volumeName="kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-bound-sa-token" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257237    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="21b1d440-8b5c-4e0b-b3bf-e74befdce48e" volumeName="kubernetes.io/projected/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-kube-api-access-4z9tp" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257245    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="21b1d440-8b5c-4e0b-b3bf-e74befdce48e" volumeName="kubernetes.io/secret/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-serving-cert" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257252    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34e89d20-b285-4246-8184-9fe736a2c6fb" volumeName="kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257259    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87b38c08-ae1d-4961-bd80-f0198dec4a22" volumeName="kubernetes.io/configmap/87b38c08-ae1d-4961-bd80-f0198dec4a22-cni-binary-copy" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257266    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa1a36c1-6032-42fe-aec6-97d2cc67bc0c" volumeName="kubernetes.io/secret/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-serving-cert" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257282    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0" volumeName="kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257290    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0" volumeName="kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovnkube-config" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257298    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04f91be3-79d3-4f15-a7ba-f2d0bb249e02" volumeName="kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-trusted-ca" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257305    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf3347a5-26a7-4708-abb3-e3a39308f782" volumeName="kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257313    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d204b46f-c6a4-440f-8078-ce647d423f59" volumeName="kubernetes.io/empty-dir/d204b46f-c6a4-440f-8078-ce647d423f59-tmp-dir" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257322    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06028e29-e135-48d5-aa5d-2c625009150d" volumeName="kubernetes.io/configmap/06028e29-e135-48d5-aa5d-2c625009150d-iptables-alerter-script" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257329    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="75581bb4-9213-4894-ad60-5cbe03c4ff6c" volumeName="kubernetes.io/configmap/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-config" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257337    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86386c5c-e63e-4a97-a58e-ee79814a585f" volumeName="kubernetes.io/projected/86386c5c-e63e-4a97-a58e-ee79814a585f-kube-api-access-97prz" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257348    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86ced41b-f67d-4a69-9c48-81be43c75698" volumeName="kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-default-certificate" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257356    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93430674-7eab-453f-a278-c8d352572441" volumeName="kubernetes.io/empty-dir/93430674-7eab-453f-a278-c8d352572441-data-volume" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257383    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b502ddfa-b655-45b6-9b0f-e936f85a0fcb" volumeName="kubernetes.io/empty-dir/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-tmp" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257393    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04f91be3-79d3-4f15-a7ba-f2d0bb249e02" volumeName="kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-installation-pull-secrets" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257405    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06028e29-e135-48d5-aa5d-2c625009150d" volumeName="kubernetes.io/projected/06028e29-e135-48d5-aa5d-2c625009150d-kube-api-access-f2v6p" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257416    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d040316-e799-40d0-b5ee-2a4351ca99bd" volumeName="kubernetes.io/secret/2d040316-e799-40d0-b5ee-2a4351ca99bd-cert" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257428    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d262282-6f9c-4945-959d-81e9a9a12392" volumeName="kubernetes.io/configmap/9d262282-6f9c-4945-959d-81e9a9a12392-trusted-ca" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257440    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0" volumeName="kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-env-overrides" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257073    4948 manager.go:319] Starting recovery of all containers
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257451    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d262282-6f9c-4945-959d-81e9a9a12392" volumeName="kubernetes.io/secret/9d262282-6f9c-4945-959d-81e9a9a12392-serving-cert" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257499    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2a12cab-f546-4344-8460-3f967e181eeb" volumeName="kubernetes.io/projected/b2a12cab-f546-4344-8460-3f967e181eeb-kube-api-access-89r9b" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257537    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0f30507-57cb-4145-bd0c-f44b3698d7ab" volumeName="kubernetes.io/configmap/f0f30507-57cb-4145-bd0c-f44b3698d7ab-serviceca" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257552    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2a12cab-f546-4344-8460-3f967e181eeb" volumeName="kubernetes.io/secret/b2a12cab-f546-4344-8460-3f967e181eeb-serving-cert" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257565    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04f91be3-79d3-4f15-a7ba-f2d0bb249e02" volumeName="kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-certificates" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257601    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2c88c202-657d-49fd-83af-da47476931a9" volumeName="kubernetes.io/configmap/2c88c202-657d-49fd-83af-da47476931a9-nginx-conf" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257615    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="75581bb4-9213-4894-ad60-5cbe03c4ff6c" volumeName="kubernetes.io/projected/75581bb4-9213-4894-ad60-5cbe03c4ff6c-kube-api-access-l6w9q" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257629    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86386c5c-e63e-4a97-a58e-ee79814a585f" volumeName="kubernetes.io/configmap/86386c5c-e63e-4a97-a58e-ee79814a585f-telemetry-config" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257642    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c" volumeName="kubernetes.io/projected/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-kube-api-access-wz6t9" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257654    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0" volumeName="kubernetes.io/projected/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-kube-api-access-slmhq" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257667    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="21b1d440-8b5c-4e0b-b3bf-e74befdce48e" volumeName="kubernetes.io/configmap/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257678    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d040316-e799-40d0-b5ee-2a4351ca99bd" volumeName="kubernetes.io/projected/2d040316-e799-40d0-b5ee-2a4351ca99bd-kube-api-access-p6xjn" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257690    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87b38c08-ae1d-4961-bd80-f0198dec4a22" volumeName="kubernetes.io/configmap/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-daemon-config" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257703    4948 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90198fcb-a25b-4437-965b-750ede2da138" volumeName="kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-registry-certificates" seLinuxMountContext=""
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257714    4948 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 20:38:52.257861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.257721    4948 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 20:38:52.262423 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.262395    4948 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:52.262734 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.262581    4948 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 20:38:52.265825 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.265780    4948 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:52.266546 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.266489    4948 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:52.279218 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.278748    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/1.log"
Oct 30 20:38:52.281391 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.280692    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/1.log"
Oct 30 20:38:52.286611 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.285131    4948 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 20:38:52.286611 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.286246    4948 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 20:38:52.286611 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.286261    4948 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 20:38:52.286611 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.286279    4948 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 20:38:52.286611 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:52.286315    4948 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 20:38:52.290552 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.290499    4948 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:52.306294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.306251    4948 generic.go:356] "Generic (PLEG): container finished" podID="5f4a5d3da19d20e6931f18f86a441dd3" containerID="a69acb1c6b066ac35aa9dfd83a1968d768da97fea8e880d9574284bc1ff7a454" exitCode=0
Oct 30 20:38:52.318517 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.318493    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/1.log"
Oct 30 20:38:52.318653 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.318521    4948 generic.go:356] "Generic (PLEG): container finished" podID="9d262282-6f9c-4945-959d-81e9a9a12392" containerID="06135342ee3628b382371bbace43209766db17b7fa0070231425c40fbe4e46a3" exitCode=255
Oct 30 20:38:52.326804 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.326781    4948 generic.go:356] "Generic (PLEG): container finished" podID="f7716064-3190-400e-be69-91ee32a14749" containerID="743a4d3d695e0d657779cd3d02e8e57d8626f70dab1e6e726c2354faca890eac" exitCode=0
Oct 30 20:38:52.326804 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.326803    4948 generic.go:356] "Generic (PLEG): container finished" podID="f7716064-3190-400e-be69-91ee32a14749" containerID="fc7bd1367178f55bd3ea9f9ab4c0f5d08536c024b39bcd9065844e7f2c0f2b94" exitCode=0
Oct 30 20:38:52.326804 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.326809    4948 generic.go:356] "Generic (PLEG): container finished" podID="f7716064-3190-400e-be69-91ee32a14749" containerID="9df2b171391a21e662e5fc0aa22d9738f82aa82a50b419eb6ca056e7a6f8a13a" exitCode=0
Oct 30 20:38:52.327033 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.326815    4948 generic.go:356] "Generic (PLEG): container finished" podID="f7716064-3190-400e-be69-91ee32a14749" containerID="e3cde09f55cdab039519aa806f4a905be85ca760a89813921d4679dca64395e3" exitCode=0
Oct 30 20:38:52.327033 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.326821    4948 generic.go:356] "Generic (PLEG): container finished" podID="f7716064-3190-400e-be69-91ee32a14749" containerID="98d5f3ff536585f5cb6f05eddb68d3dc9f14b3191dfe8c34a8d215cf5f6d1941" exitCode=0
Oct 30 20:38:52.327033 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.326826    4948 generic.go:356] "Generic (PLEG): container finished" podID="f7716064-3190-400e-be69-91ee32a14749" containerID="14de3e680f846dd7be1b425e3a12ac3ab033f8419036bdc3dc35713676a4b6ae" exitCode=0
Oct 30 20:38:52.351148 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.351094    4948 manager.go:324] Recovery completed
Oct 30 20:38:52.371663 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.371639    4948 cpu_manager.go:226] "Starting" policy="none"
Oct 30 20:38:52.371663 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.371657    4948 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 20:38:52.371810 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.371677    4948 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 20:38:52.371845 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.371817    4948 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 20:38:52.371874 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.371831    4948 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 20:38:52.371874 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.371865    4948 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 20:38:52.371874 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.371873    4948 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 20:38:52.371956 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.371880    4948 policy_none.go:50] "Start"
Oct 30 20:38:52.371956 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.371899    4948 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 20:38:52.371956 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.371912    4948 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 20:38:52.372054 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.372043    4948 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 20:38:52.372084 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.372054    4948 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 20:38:52.372084 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.372060    4948 policy_none.go:44] "Start"
Oct 30 20:38:52.376265 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.376235    4948 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 20:38:52.378866 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.378853    4948 manager.go:341] "Starting Device Plugin manager"
Oct 30 20:38:52.379307 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:52.378880    4948 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 20:38:52.379395 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.379309    4948 server.go:87] "Starting device plugin registration server"
Oct 30 20:38:52.379610 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.379597    4948 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 20:38:52.379672 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.379611    4948 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 20:38:52.379745 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.379727    4948 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 20:38:52.379856 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.379822    4948 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 20:38:52.379902 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.379865    4948 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 20:38:52.379902 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.379872    4948 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 20:38:52.380005 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.379936    4948 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T20:38:52.379855098Z","UUID":"856690c8-da42-4b07-8448-e33717369754","Handler":null,"Name":"","Endpoint":""}
Oct 30 20:38:52.381277 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.381258    4948 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 20:38:52.381384 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.381284    4948 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 20:38:52.381629 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:52.381607    4948 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 20:38:52.386452 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.386410    4948 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal"]
Oct 30 20:38:52.387074 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.387043    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal" event={"ID":"5f4a5d3da19d20e6931f18f86a441dd3","Type":"ContainerStarted","Data":"b4483e4fab513b0bb6917a97630301a9bc5f541638ca60575dac8189c7dc73db"}
Oct 30 20:38:52.387180 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.387084    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal" event={"ID":"5f4a5d3da19d20e6931f18f86a441dd3","Type":"ContainerDied","Data":"a69acb1c6b066ac35aa9dfd83a1968d768da97fea8e880d9574284bc1ff7a454"}
Oct 30 20:38:52.387180 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.387091    4948 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:52.387180 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.387106    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal" event={"ID":"5f4a5d3da19d20e6931f18f86a441dd3","Type":"ContainerStarted","Data":"e5acf9f9d41e2b99f41fdb1f8e26624d5c17ee0caee498d1ecf395ee5b7f3fc1"}
Oct 30 20:38:52.387348 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.387183    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal" event={"ID":"289e7d851e39af0854a82e99a8d41138","Type":"ContainerStarted","Data":"014b953cb3c4cd27568fb164dbfb65a4f514459e3b6ff132e85635a2505456db"}
Oct 30 20:38:52.387348 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.387204    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal" event={"ID":"289e7d851e39af0854a82e99a8d41138","Type":"ContainerStarted","Data":"b37c02572e3aa5c5eb7774ce952dfd2a84d29c5bcc98fd5a7e661bf34c66f1e3"}
Oct 30 20:38:52.387469 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.387398    4948 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:52.407241 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.407222    4948 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:52.407323 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:52.407263    4948 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:52.463339 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.463313    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f4a5d3da19d20e6931f18f86a441dd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"5f4a5d3da19d20e6931f18f86a441dd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:52.463459 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.463344    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f4a5d3da19d20e6931f18f86a441dd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"5f4a5d3da19d20e6931f18f86a441dd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:52.463459 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.463388    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/289e7d851e39af0854a82e99a8d41138-config\") pod \"kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"289e7d851e39af0854a82e99a8d41138\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:52.480423 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.480403    4948 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:52.481588 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.481574    4948 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:52.481647 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.481602    4948 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:52.481647 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.481618    4948 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-183.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:52.481721 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.481665    4948 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:52.497606 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.497587    4948 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:52.497669 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.497646    4948 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:52.504327 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.504306    4948 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:52.504433 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:52.504351    4948 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:52.563927 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.563892    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f4a5d3da19d20e6931f18f86a441dd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"5f4a5d3da19d20e6931f18f86a441dd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:52.564054 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.563938    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/289e7d851e39af0854a82e99a8d41138-config\") pod \"kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"289e7d851e39af0854a82e99a8d41138\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:52.564054 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.563957    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f4a5d3da19d20e6931f18f86a441dd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"5f4a5d3da19d20e6931f18f86a441dd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:52.564054 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.563963    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f4a5d3da19d20e6931f18f86a441dd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"5f4a5d3da19d20e6931f18f86a441dd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:52.564054 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.563993    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f4a5d3da19d20e6931f18f86a441dd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"5f4a5d3da19d20e6931f18f86a441dd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:52.564054 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:52.564008    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/289e7d851e39af0854a82e99a8d41138-config\") pod \"kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal\" (UID: \"289e7d851e39af0854a82e99a8d41138\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:53.241055 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.241015    4948 apiserver.go:52] "Watching apiserver"
Oct 30 20:38:53.257795 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.257748    4948 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 20:38:53.258759 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.258732    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kjcfz","kube-system/kas-connection-checker-685895c7c9-cd525","openshift-multus/network-metrics-daemon-n7qt5","openshift-network-operator/iptables-alerter-xkzc8","openshift-ovn-kubernetes/ovnkube-node-6nqrx","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4","openshift-dns/node-resolver-8g6wj","kube-system/konnectivity-agent-7wl8g","openshift-ingress/router-default-7fc784755f-fpdq5","openshift-image-registry/image-registry-79c6d8c76d-pvcm5","openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m","openshift-network-diagnostics/network-check-target-qwmdw","openshift-dns/dns-default-xchc6","openshift-cluster-node-tuning-operator/tuned-kbbkm","openshift-insights/insights-operator-7c4986d449-sxgrn","openshift-console-operator/console-operator-7cd56b8dbc-pjhmq","openshift-image-registry/image-registry-6fcdccbdf7-r26s9","openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz","openshift-kube-storage-version-migrator/migrator-66df5d496b-49kcm","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qthmt","kube-system/kas-connection-checker-685895c7c9-sbz2m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal","openshift-ingress-canary/ingress-canary-gxp9z","openshift-network-diagnostics/network-check-source-6f78d59f99-h5lvt","kube-system/global-pull-secret-syncer-jk8sp","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd","openshift-multus/multus-additional-cni-plugins-rs9rh","openshift-network-console/networking-console-plugin-86c478bb88-fx72n","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5","openshift-multus/multus-rt5dq","kube-system/kas-connection-checker-685895c7c9-5rf4c","kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal","openshift-image-registry/node-ca-778mq"]
Oct 30 20:38:53.259896 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.259878    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:53.261370 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.261338    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:53.261683 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.261668    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.262351 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.262334    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:53.263006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.262990    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:53.265382 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.265351    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:53.266233 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.266213    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 20:38:53.266328 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.266263    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 20:38:53.266328 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.266218    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 20:38:53.266328 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.266291    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 20:38:53.266508 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.266336    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 20:38:53.266508 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.266341    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 20:38:53.266508 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.266395    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 20:38:53.266508 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.266415    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 20:38:53.266508 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.266435    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 20:38:53.266508 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.266420    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 20:38:53.266508 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.266452    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 20:38:53.266713 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.266511    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-2jnwc\""
Oct 30 20:38:53.266713 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.266550    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 20:38:53.267242 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.267225    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.267339 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.267321    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-r2q8w\""
Oct 30 20:38:53.267432 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.267419    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9r6zk\""
Oct 30 20:38:53.267493 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.267443    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 20:38:53.271633 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.271611    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.271765 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.271751    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.271823 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.271770    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.271869 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.271847    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 20:38:53.271913 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.271872    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.271957 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.271949    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.272072 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.272054    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.272135 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.272120    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.272178 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.272151    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 20:38:53.272270 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.272254    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.272313 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.272294    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.272420 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.272398    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.272708 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.272456    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 20:38:53.272708 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.272526    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.272708 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.272668    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.272708 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.272709    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.272961 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.272813    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 20:38:53.273122 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.273106    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 20:38:53.273261 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.273237    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.273316 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.273264    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.273426 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.273406    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 20:38:53.273510 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.273484    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.273510 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.273501    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 20:38:53.273712 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.273696    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 20:38:53.273869 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.273116    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 20:38:53.274028 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.273985    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 20:38:53.274181 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.274035    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:38:53.274248 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.273497    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.274248 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.274091    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.274340 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.273719    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 20:38:53.274340 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.274265    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 20:38:53.274340 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.274278    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 20:38:53.274340 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.274332    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 20:38:53.274567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.274411    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 20:38:53.274567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.274347    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.274567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.274444    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.274567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.274457    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.274567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.274485    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.274567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.273711    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cctqn\""
Oct 30 20:38:53.274567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.274523    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.274800 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.274629    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.274800 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.274629    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.274800 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.274707    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.275974 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.275960    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z6v2d\""
Oct 30 20:38:53.276435 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.276417    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:53.276508 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.276492    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 20:38:53.276627 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.276611    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-wzc24\""
Oct 30 20:38:53.276688 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.276629    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 20:38:53.276688 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.276661    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6zzqh\""
Oct 30 20:38:53.276688 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.276682    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mnk4k\""
Oct 30 20:38:53.276805 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.276712    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.276805 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.276728    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.276805 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.276728    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.276805 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.276763    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.276805 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.276787    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.276948 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.276824    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.276987 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.276948    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:53.277233 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.277207    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9s58x\""
Oct 30 20:38:53.277667 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.277641    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-q55wr\""
Oct 30 20:38:53.278393 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.278375    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 20:38:53.280557 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.280518    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 20:38:53.280638 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.280520    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 20:38:53.280638 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.280625    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jrnvk\""
Oct 30 20:38:53.281794 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.281780    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-r8zbf\""
Oct 30 20:38:53.282120 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.282098    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:38:53.282202 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.282117    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 20:38:53.282202 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.282181    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.282202 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.282195    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 20:38:53.282339 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.282201    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.282339 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.282276    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 20:38:53.282339 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.282279    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.282339 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.282313    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.282515 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.282406    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 20:38:53.282515 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.282416    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nxdl7\""
Oct 30 20:38:53.282515 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.282440    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4f5dn\""
Oct 30 20:38:53.283000 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.282981    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 20:38:53.283102 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.283087    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 20:38:53.283148 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.283114    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 20:38:53.283148 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.283140    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 20:38:53.283219 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.283166    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 20:38:53.283219 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.283181    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 20:38:53.283219 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.283169    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:53.283334 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.283227    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8f8mm\""
Oct 30 20:38:53.283334 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.283285    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6gb67\""
Oct 30 20:38:53.283427 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.283346    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kxrnf\""
Oct 30 20:38:53.283427 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.283351    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gk5pt\""
Oct 30 20:38:53.342116 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.342091    4948 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:53.342266 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.342219    4948 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:53.354916 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.354894    4948 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:53.355017 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.354930    4948 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:53.355713 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.355692    4948 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:53.355798 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.355745    4948 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-183.us-east-2.compute.internal"
Oct 30 20:38:53.360316 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.360266    4948 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 20:38:53.367699 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.367681    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:53.367771 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.367709    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-systemd\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.367771 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.367727    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mjsj\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-kube-api-access-9mjsj\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.367771 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.367743    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6xh6\" (UniqueName: \"kubernetes.io/projected/7e9d8fb4-c43e-4973-b67b-7cca18f00408-kube-api-access-v6xh6\") pod \"volume-data-source-validator-58c9f5f46d-qthmt\" (UID: \"7e9d8fb4-c43e-4973-b67b-7cca18f00408\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qthmt"
Oct 30 20:38:53.367771 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.367760    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-multus-certs\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.367935 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.367887    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6xjn\" (UniqueName: \"kubernetes.io/projected/2d040316-e799-40d0-b5ee-2a4351ca99bd-kube-api-access-p6xjn\") pod \"ingress-canary-gxp9z\" (UID: \"2d040316-e799-40d0-b5ee-2a4351ca99bd\") " pod="openshift-ingress-canary/ingress-canary-gxp9z"
Oct 30 20:38:53.367935 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.367924    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:53.368007 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.367981    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2v6p\" (UniqueName: \"kubernetes.io/projected/06028e29-e135-48d5-aa5d-2c625009150d-kube-api-access-f2v6p\") pod \"iptables-alerter-xkzc8\" (UID: \"06028e29-e135-48d5-aa5d-2c625009150d\") " pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:53.368047 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368020    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-sys\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.368082 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368047    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-cni-multus\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.368127 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368095    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/34e89d20-b285-4246-8184-9fe736a2c6fb-original-pull-secret\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:53.368127 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368092    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-etc-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.368188 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368133    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.368188 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368153    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:53.368188 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368181    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c9a4a383-c9b9-4475-b22e-d336d1a35422-agent-certs\") pod \"konnectivity-agent-7wl8g\" (UID: \"c9a4a383-c9b9-4475-b22e-d336d1a35422\") " pod="kube-system/konnectivity-agent-7wl8g"
Oct 30 20:38:53.368294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368218    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:53.368294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368246    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-cni-bin\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.368405 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368320    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-systemd-units\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.368456 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368388    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-systemd\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.368521 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368433    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d204b46f-c6a4-440f-8078-ce647d423f59-config-volume\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:53.368521 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368501    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/06028e29-e135-48d5-aa5d-2c625009150d-iptables-alerter-script\") pod \"iptables-alerter-xkzc8\" (UID: \"06028e29-e135-48d5-aa5d-2c625009150d\") " pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:53.368632 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368528    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysctl-d\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.368632 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368559    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysctl-conf\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.368632 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368572    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c9a4a383-c9b9-4475-b22e-d336d1a35422-agent-certs\") pod \"konnectivity-agent-7wl8g\" (UID: \"c9a4a383-c9b9-4475-b22e-d336d1a35422\") " pod="kube-system/konnectivity-agent-7wl8g"
Oct 30 20:38:53.368632 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368589    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-sys-fs\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.368632 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368625    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.368846 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368650    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-bound-sa-token\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.368846 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368684    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-image-registry-private-configuration\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.368846 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368695    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d204b46f-c6a4-440f-8078-ce647d423f59-config-volume\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:53.368846 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368729    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/06028e29-e135-48d5-aa5d-2c625009150d-iptables-alerter-script\") pod \"iptables-alerter-xkzc8\" (UID: \"06028e29-e135-48d5-aa5d-2c625009150d\") " pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:53.368846 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368741    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztctx\" (UniqueName: \"kubernetes.io/projected/86ced41b-f67d-4a69-9c48-81be43c75698-kube-api-access-ztctx\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:53.368846 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368767    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-registration-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.368846 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368825    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-image-registry-private-configuration\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.368846 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368831    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0f30507-57cb-4145-bd0c-f44b3698d7ab-serviceca\") pod \"node-ca-778mq\" (UID: \"f0f30507-57cb-4145-bd0c-f44b3698d7ab\") " pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:53.369175 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368880    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-snapshots\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:53.369175 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368898    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-tmp\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.369175 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368952    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-tmp\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.369175 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368962    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:53.369175 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.368995    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-snapshots\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:53.369175 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369008    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-var-lib-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.369175 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369042    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-run\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.369175 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369066    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-host\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.369175 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369044    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0f30507-57cb-4145-bd0c-f44b3698d7ab-serviceca\") pod \"node-ca-778mq\" (UID: \"f0f30507-57cb-4145-bd0c-f44b3698d7ab\") " pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:53.369175 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369094    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-trusted-ca\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.369175 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369123    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-installation-pull-secrets\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369188    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369211    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-slash\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369236    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4\" (UID: \"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369298    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369317    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-run-netns\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369337    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-hostroot\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369372    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll7j5\" (UniqueName: \"kubernetes.io/projected/f264b5d9-bc95-4e78-b399-43e8148c8768-kube-api-access-ll7j5\") pod \"kas-connection-checker-685895c7c9-cd525\" (UID: \"f264b5d9-bc95-4e78-b399-43e8148c8768\") " pod="kube-system/kas-connection-checker-685895c7c9-cd525"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369394    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4\" (UID: \"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369398    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-installation-pull-secrets\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369429    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-default-certificate\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369437    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-trusted-ca\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369552    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369557    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86386c5c-e63e-4a97-a58e-ee79814a585f-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369603    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369623    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369634    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-default-certificate\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369642    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-tuned\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369682    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-kubelet\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369707    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2a12cab-f546-4344-8460-3f967e181eeb-serving-cert\") pod \"service-ca-operator-544d749c8c-frc7m\" (UID: \"b2a12cab-f546-4344-8460-3f967e181eeb\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369715    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-tuned\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.369716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369728    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz6t9\" (UniqueName: \"kubernetes.io/projected/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-kube-api-access-wz6t9\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369755    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-k8s-cni-cncf-io\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369778    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-installation-pull-secrets\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369824    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzclf\" (UniqueName: \"kubernetes.io/projected/d204b46f-c6a4-440f-8078-ce647d423f59-kube-api-access-nzclf\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369841    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86386c5c-e63e-4a97-a58e-ee79814a585f-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369851    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-lib-modules\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.369974    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-socket-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370016    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzwtl\" (UniqueName: \"kubernetes.io/projected/e9ba6324-4a54-40b9-8c8c-b2dee0510797-kube-api-access-lzwtl\") pod \"kas-connection-checker-685895c7c9-sbz2m\" (UID: \"e9ba6324-4a54-40b9-8c8c-b2dee0510797\") " pod="kube-system/kas-connection-checker-685895c7c9-sbz2m"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370047    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2a12cab-f546-4344-8460-3f967e181eeb-serving-cert\") pod \"service-ca-operator-544d749c8c-frc7m\" (UID: \"b2a12cab-f546-4344-8460-3f967e181eeb\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370166    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvkf4\" (UniqueName: \"kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4\") pod \"network-check-target-qwmdw\" (UID: \"cf3347a5-26a7-4708-abb3-e3a39308f782\") " pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370190    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-system-cni-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370190    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-installation-pull-secrets\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370205    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87b38c08-ae1d-4961-bd80-f0198dec4a22-cni-binary-copy\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370226    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-conf-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370227    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370276    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-etc-kubernetes\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370327    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovnkube-config\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370346    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2a12cab-f546-4344-8460-3f967e181eeb-config\") pod \"service-ca-operator-544d749c8c-frc7m\" (UID: \"b2a12cab-f546-4344-8460-3f967e181eeb\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370378    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-bound-sa-token\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370394    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-cnibin\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370418    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4psg6\" (UniqueName: \"kubernetes.io/projected/87b38c08-ae1d-4961-bd80-f0198dec4a22-kube-api-access-4psg6\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370444    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-cni-binary-copy\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370468    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370495    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-cni-bin\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370503    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87b38c08-ae1d-4961-bd80-f0198dec4a22-cni-binary-copy\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370520    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slmhq\" (UniqueName: \"kubernetes.io/projected/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-kube-api-access-slmhq\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370543    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv82j\" (UniqueName: \"kubernetes.io/projected/f0f30507-57cb-4145-bd0c-f44b3698d7ab-kube-api-access-rv82j\") pod \"node-ca-778mq\" (UID: \"f0f30507-57cb-4145-bd0c-f44b3698d7ab\") " pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370557    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2a12cab-f546-4344-8460-3f967e181eeb-config\") pod \"service-ca-operator-544d749c8c-frc7m\" (UID: \"b2a12cab-f546-4344-8460-3f967e181eeb\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"
Oct 30 20:38:53.370567 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370571    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-stats-auth\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370596    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-cni-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370624    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-kubelet\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370651    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370596    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovnkube-config\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370708    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370700    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34e89d20-b285-4246-8184-9fe736a2c6fb-dbus\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370717    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7716064-3190-400e-be69-91ee32a14749-cni-binary-copy\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370780    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt4gk\" (UniqueName: \"kubernetes.io/projected/a531c68c-5ab5-408a-ae30-640a1bc4c8ab-kube-api-access-mt4gk\") pod \"migrator-66df5d496b-49kcm\" (UID: \"a531c68c-5ab5-408a-ae30-640a1bc4c8ab\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-49kcm"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370817    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370867    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370892    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370919    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0f30507-57cb-4145-bd0c-f44b3698d7ab-host\") pod \"node-ca-778mq\" (UID: \"f0f30507-57cb-4145-bd0c-f44b3698d7ab\") " pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370944    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571e6927-684b-4d97-b9ab-4d2581d5235a-tmp-dir\") pod \"node-resolver-8g6wj\" (UID: \"571e6927-684b-4d97-b9ab-4d2581d5235a\") " pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370939    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-stats-auth\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.370975    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93430674-7eab-453f-a278-c8d352572441-crio-socket\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371000    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d262282-6f9c-4945-959d-81e9a9a12392-trusted-ca\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371025    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571e6927-684b-4d97-b9ab-4d2581d5235a-tmp-dir\") pod \"node-resolver-8g6wj\" (UID: \"571e6927-684b-4d97-b9ab-4d2581d5235a\") " pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371034    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c9a4a383-c9b9-4475-b22e-d336d1a35422-konnectivity-ca\") pod \"konnectivity-agent-7wl8g\" (UID: \"c9a4a383-c9b9-4475-b22e-d336d1a35422\") " pod="kube-system/konnectivity-agent-7wl8g"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371053    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbtq7\" (UniqueName: \"kubernetes.io/projected/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-kube-api-access-nbtq7\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371157    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90198fcb-a25b-4437-965b-750ede2da138-ca-trust-extracted\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371195    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97prz\" (UniqueName: \"kubernetes.io/projected/86386c5c-e63e-4a97-a58e-ee79814a585f-kube-api-access-97prz\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371210    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d204b46f-c6a4-440f-8078-ce647d423f59-tmp-dir\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371223    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-tmp\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371238    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-log-socket\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371253    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-serving-cert\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371278    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-service-ca-bundle\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371302    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsx2t\" (UniqueName: \"kubernetes.io/projected/990e57a8-4ba2-43be-8108-2bcf3b8da004-kube-api-access-nsx2t\") pod \"kas-connection-checker-685895c7c9-5rf4c\" (UID: \"990e57a8-4ba2-43be-8108-2bcf3b8da004\") " pod="kube-system/kas-connection-checker-685895c7c9-5rf4c"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371326    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-tmp\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371330    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-ovn\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371346    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d204b46f-c6a4-440f-8078-ce647d423f59-tmp-dir\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371356    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d262282-6f9c-4945-959d-81e9a9a12392-trusted-ca\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371441    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c9a4a383-c9b9-4475-b22e-d336d1a35422-konnectivity-ca\") pod \"konnectivity-agent-7wl8g\" (UID: \"c9a4a383-c9b9-4475-b22e-d336d1a35422\") " pod="kube-system/konnectivity-agent-7wl8g"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371444    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovn-node-metrics-cert\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371487    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovnkube-script-lib\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371514    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93430674-7eab-453f-a278-c8d352572441-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371550    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2c88c202-657d-49fd-83af-da47476931a9-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371574    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npfcb\" (UniqueName: \"kubernetes.io/projected/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-kube-api-access-npfcb\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4\" (UID: \"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371578    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-service-ca-bundle\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371632    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovn-node-metrics-cert\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371658    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90198fcb-a25b-4437-965b-750ede2da138-ca-trust-extracted\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371736    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-modprobe-d\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371763    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-ovnkube-script-lib\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371773    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-serving-cert\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:53.371832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371817    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-device-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371883    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-cni-netd\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371916    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d262282-6f9c-4945-959d-81e9a9a12392-serving-cert\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371949    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2c88c202-657d-49fd-83af-da47476931a9-nginx-conf\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.371968    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmxmn\" (UniqueName: \"kubernetes.io/projected/dda1e37e-2f98-46b0-8ad9-632d308a5744-kube-api-access-wmxmn\") pod \"network-check-source-6f78d59f99-h5lvt\" (UID: \"dda1e37e-2f98-46b0-8ad9-632d308a5744\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h5lvt"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372069    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d262282-6f9c-4945-959d-81e9a9a12392-serving-cert\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372095    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93430674-7eab-453f-a278-c8d352572441-data-volume\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372129    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06028e29-e135-48d5-aa5d-2c625009150d-host-slash\") pod \"iptables-alerter-xkzc8\" (UID: \"06028e29-e135-48d5-aa5d-2c625009150d\") " pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372173    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tk25\" (UniqueName: \"kubernetes.io/projected/571e6927-684b-4d97-b9ab-4d2581d5235a-kube-api-access-7tk25\") pod \"node-resolver-8g6wj\" (UID: \"571e6927-684b-4d97-b9ab-4d2581d5235a\") " pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372206    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93430674-7eab-453f-a278-c8d352572441-data-volume\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372210    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysconfig\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372251    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-cnibin\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372278    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-image-registry-private-configuration\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372297    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372316    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-socket-dir-parent\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372339    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-etc-selinux\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372387    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt972\" (UniqueName: \"kubernetes.io/projected/34f5534a-5450-43a0-8d78-bc7e362bcfa9-kube-api-access-jt972\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372415    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rk9l\" (UniqueName: \"kubernetes.io/projected/9d262282-6f9c-4945-959d-81e9a9a12392-kube-api-access-6rk9l\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372431    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-daemon-config\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372460    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l45ml\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-kube-api-access-l45ml\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372512    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-image-registry-private-configuration\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372563    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372607    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d262282-6f9c-4945-959d-81e9a9a12392-config\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372628    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-daemon-config\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372686    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kfg8\" (UniqueName: \"kubernetes.io/projected/f7716064-3190-400e-be69-91ee32a14749-kube-api-access-2kfg8\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372767    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-registry-certificates\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372795    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d262282-6f9c-4945-959d-81e9a9a12392-config\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372859    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-trusted-ca\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372876    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4\" (UID: \"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372958    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372987    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-registry-certificates\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.372988    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/571e6927-684b-4d97-b9ab-4d2581d5235a-hosts-file\") pod \"node-resolver-8g6wj\" (UID: \"571e6927-684b-4d97-b9ab-4d2581d5235a\") " pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373030    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4\" (UID: \"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373038    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z9tp\" (UniqueName: \"kubernetes.io/projected/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-kube-api-access-4z9tp\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373080    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-ca-trust-extracted\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373125    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-kubernetes\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373169    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-ca-trust-extracted\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373171    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-var-lib-kubelet\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373200    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89r9b\" (UniqueName: \"kubernetes.io/projected/b2a12cab-f546-4344-8460-3f967e181eeb-kube-api-access-89r9b\") pod \"service-ca-operator-544d749c8c-frc7m\" (UID: \"b2a12cab-f546-4344-8460-3f967e181eeb\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373204    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-trusted-ca\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373235    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-system-cni-dir\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373320    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-env-overrides\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373338    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:53.373389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373401    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-netns\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.374742 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373493    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-env-overrides\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.374742 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373513    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6w9q\" (UniqueName: \"kubernetes.io/projected/75581bb4-9213-4894-ad60-5cbe03c4ff6c-kube-api-access-l6w9q\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:53.374742 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373545    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-node-log\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.374742 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373575    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wwsv\" (UniqueName: \"kubernetes.io/projected/93430674-7eab-453f-a278-c8d352572441-kube-api-access-5wwsv\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:53.374742 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373609    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-certificates\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.374742 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373676    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d040316-e799-40d0-b5ee-2a4351ca99bd-cert\") pod \"ingress-canary-gxp9z\" (UID: \"2d040316-e799-40d0-b5ee-2a4351ca99bd\") " pod="openshift-ingress-canary/ingress-canary-gxp9z"
Oct 30 20:38:53.374742 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373707    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.374742 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373731    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34e89d20-b285-4246-8184-9fe736a2c6fb-kubelet-config\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:53.374742 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373734    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-certificates\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.374742 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.373951    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d040316-e799-40d0-b5ee-2a4351ca99bd-cert\") pod \"ingress-canary-gxp9z\" (UID: \"2d040316-e799-40d0-b5ee-2a4351ca99bd\") " pod="openshift-ingress-canary/ingress-canary-gxp9z"
Oct 30 20:38:53.378495 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.378480    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2v6p\" (UniqueName: \"kubernetes.io/projected/06028e29-e135-48d5-aa5d-2c625009150d-kube-api-access-f2v6p\") pod \"iptables-alerter-xkzc8\" (UID: \"06028e29-e135-48d5-aa5d-2c625009150d\") " pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:53.379994 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.379977    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mjsj\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-kube-api-access-9mjsj\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.383419 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.383399    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz6t9\" (UniqueName: \"kubernetes.io/projected/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-kube-api-access-wz6t9\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:53.383541 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.383522    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzclf\" (UniqueName: \"kubernetes.io/projected/d204b46f-c6a4-440f-8078-ce647d423f59-kube-api-access-nzclf\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:53.383627 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.383612    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztctx\" (UniqueName: \"kubernetes.io/projected/86ced41b-f67d-4a69-9c48-81be43c75698-kube-api-access-ztctx\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:53.383787 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.383771    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzwtl\" (UniqueName: \"kubernetes.io/projected/e9ba6324-4a54-40b9-8c8c-b2dee0510797-kube-api-access-lzwtl\") pod \"kas-connection-checker-685895c7c9-sbz2m\" (UID: \"e9ba6324-4a54-40b9-8c8c-b2dee0510797\") " pod="kube-system/kas-connection-checker-685895c7c9-sbz2m"
Oct 30 20:38:53.383974 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.383946    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-bound-sa-token\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.386683 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.386668    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6xjn\" (UniqueName: \"kubernetes.io/projected/2d040316-e799-40d0-b5ee-2a4351ca99bd-kube-api-access-p6xjn\") pod \"ingress-canary-gxp9z\" (UID: \"2d040316-e799-40d0-b5ee-2a4351ca99bd\") " pod="openshift-ingress-canary/ingress-canary-gxp9z"
Oct 30 20:38:53.387462 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.387441    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt4gk\" (UniqueName: \"kubernetes.io/projected/a531c68c-5ab5-408a-ae30-640a1bc4c8ab-kube-api-access-mt4gk\") pod \"migrator-66df5d496b-49kcm\" (UID: \"a531c68c-5ab5-408a-ae30-640a1bc4c8ab\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-49kcm"
Oct 30 20:38:53.387615 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.387600    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6xh6\" (UniqueName: \"kubernetes.io/projected/7e9d8fb4-c43e-4973-b67b-7cca18f00408-kube-api-access-v6xh6\") pod \"volume-data-source-validator-58c9f5f46d-qthmt\" (UID: \"7e9d8fb4-c43e-4973-b67b-7cca18f00408\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qthmt"
Oct 30 20:38:53.388466 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.388449    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npfcb\" (UniqueName: \"kubernetes.io/projected/aa1a36c1-6032-42fe-aec6-97d2cc67bc0c-kube-api-access-npfcb\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4\" (UID: \"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4"
Oct 30 20:38:53.388618 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.388592    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv82j\" (UniqueName: \"kubernetes.io/projected/f0f30507-57cb-4145-bd0c-f44b3698d7ab-kube-api-access-rv82j\") pod \"node-ca-778mq\" (UID: \"f0f30507-57cb-4145-bd0c-f44b3698d7ab\") " pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:53.388693 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.388604    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbtq7\" (UniqueName: \"kubernetes.io/projected/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-kube-api-access-nbtq7\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.389152 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.389137    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97prz\" (UniqueName: \"kubernetes.io/projected/86386c5c-e63e-4a97-a58e-ee79814a585f-kube-api-access-97prz\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:53.390122 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.390097    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvkf4\" (UniqueName: \"kubernetes.io/projected/cf3347a5-26a7-4708-abb3-e3a39308f782-kube-api-access-dvkf4\") pod \"network-check-target-qwmdw\" (UID: \"cf3347a5-26a7-4708-abb3-e3a39308f782\") " pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:38:53.390242 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.390227    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-bound-sa-token\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.390346 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.390331    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tk25\" (UniqueName: \"kubernetes.io/projected/571e6927-684b-4d97-b9ab-4d2581d5235a-kube-api-access-7tk25\") pod \"node-resolver-8g6wj\" (UID: \"571e6927-684b-4d97-b9ab-4d2581d5235a\") " pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:53.391869 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.391848    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll7j5\" (UniqueName: \"kubernetes.io/projected/f264b5d9-bc95-4e78-b399-43e8148c8768-kube-api-access-ll7j5\") pod \"kas-connection-checker-685895c7c9-cd525\" (UID: \"f264b5d9-bc95-4e78-b399-43e8148c8768\") " pod="kube-system/kas-connection-checker-685895c7c9-cd525"
Oct 30 20:38:53.391988 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.391968    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4psg6\" (UniqueName: \"kubernetes.io/projected/87b38c08-ae1d-4961-bd80-f0198dec4a22-kube-api-access-4psg6\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.392029 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.391995    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rk9l\" (UniqueName: \"kubernetes.io/projected/9d262282-6f9c-4945-959d-81e9a9a12392-kube-api-access-6rk9l\") pod \"console-operator-7cd56b8dbc-pjhmq\" (UID: \"9d262282-6f9c-4945-959d-81e9a9a12392\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:53.392484 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.392470    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89r9b\" (UniqueName: \"kubernetes.io/projected/b2a12cab-f546-4344-8460-3f967e181eeb-kube-api-access-89r9b\") pod \"service-ca-operator-544d749c8c-frc7m\" (UID: \"b2a12cab-f546-4344-8460-3f967e181eeb\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m"
Oct 30 20:38:53.393409 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.393394    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z9tp\" (UniqueName: \"kubernetes.io/projected/21b1d440-8b5c-4e0b-b3bf-e74befdce48e-kube-api-access-4z9tp\") pod \"insights-operator-7c4986d449-sxgrn\" (UID: \"21b1d440-8b5c-4e0b-b3bf-e74befdce48e\") " pod="openshift-insights/insights-operator-7c4986d449-sxgrn"
Oct 30 20:38:53.394203 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.394183    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l45ml\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-kube-api-access-l45ml\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.394681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.394664    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmxmn\" (UniqueName: \"kubernetes.io/projected/dda1e37e-2f98-46b0-8ad9-632d308a5744-kube-api-access-wmxmn\") pod \"network-check-source-6f78d59f99-h5lvt\" (UID: \"dda1e37e-2f98-46b0-8ad9-632d308a5744\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-h5lvt"
Oct 30 20:38:53.394745 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.394691    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6w9q\" (UniqueName: \"kubernetes.io/projected/75581bb4-9213-4894-ad60-5cbe03c4ff6c-kube-api-access-l6w9q\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:53.395006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.394988    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsx2t\" (UniqueName: \"kubernetes.io/projected/990e57a8-4ba2-43be-8108-2bcf3b8da004-kube-api-access-nsx2t\") pod \"kas-connection-checker-685895c7c9-5rf4c\" (UID: \"990e57a8-4ba2-43be-8108-2bcf3b8da004\") " pod="kube-system/kas-connection-checker-685895c7c9-5rf4c"
Oct 30 20:38:53.395437 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.395416    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt972\" (UniqueName: \"kubernetes.io/projected/34f5534a-5450-43a0-8d78-bc7e362bcfa9-kube-api-access-jt972\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.395481 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.395469    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wwsv\" (UniqueName: \"kubernetes.io/projected/93430674-7eab-453f-a278-c8d352572441-kube-api-access-5wwsv\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:53.395909 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.395889    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kfg8\" (UniqueName: \"kubernetes.io/projected/f7716064-3190-400e-be69-91ee32a14749-kube-api-access-2kfg8\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:53.402810 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.402793    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slmhq\" (UniqueName: \"kubernetes.io/projected/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-kube-api-access-slmhq\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.474332 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474305    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-k8s-cni-cncf-io\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.474332 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474334    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-lib-modules\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.474531 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474350    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-socket-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.474531 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474389    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-system-cni-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.474531 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474413    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-conf-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.474531 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474422    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-k8s-cni-cncf-io\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.474531 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474435    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-etc-kubernetes\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.474531 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474464    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-cnibin\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.474531 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474466    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-socket-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.474531 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474476    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-conf-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.474531 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474492    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-etc-kubernetes\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.474531 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474509    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-cni-bin\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.474531 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474481    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-cni-bin\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.474531 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474527    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-cnibin\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474479    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-system-cni-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474541    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-cni-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474512    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-lib-modules\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474565    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-kubelet\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474588    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-cni-dir\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474601    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474626    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34e89d20-b285-4246-8184-9fe736a2c6fb-dbus\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474604    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-kubelet\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474653    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474677    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474701    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474706    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/34e89d20-b285-4246-8184-9fe736a2c6fb-dbus\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.474712    4948 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474753    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474764    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.474772    4948 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474729    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0f30507-57cb-4145-bd0c-f44b3698d7ab-host\") pod \"node-ca-778mq\" (UID: \"f0f30507-57cb-4145-bd0c-f44b3698d7ab\") " pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474795    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0f30507-57cb-4145-bd0c-f44b3698d7ab-host\") pod \"node-ca-778mq\" (UID: \"f0f30507-57cb-4145-bd0c-f44b3698d7ab\") " pod="openshift-image-registry/node-ca-778mq"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.474807    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert podName:2c88c202-657d-49fd-83af-da47476931a9 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:53.974786618 +0000 UTC m=+1.794298604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fx72n" (UID: "2c88c202-657d-49fd-83af-da47476931a9") : secret "networking-console-plugin-cert" not found
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.474830    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls podName:75581bb4-9213-4894-ad60-5cbe03c4ff6c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:53.974814941 +0000 UTC m=+1.794326909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xpnhd" (UID: "75581bb4-9213-4894-ad60-5cbe03c4ff6c") : secret "samples-operator-tls" not found
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474848    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93430674-7eab-453f-a278-c8d352572441-crio-socket\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474878    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-log-socket\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474884    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93430674-7eab-453f-a278-c8d352572441-crio-socket\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474903    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-ovn\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474931    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93430674-7eab-453f-a278-c8d352572441-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474936    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-log-socket\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474955    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-ovn\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474956    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-modprobe-d\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.474993    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-device-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.475006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475016    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-cni-netd\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475059    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-device-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475059    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-modprobe-d\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475077    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06028e29-e135-48d5-aa5d-2c625009150d-host-slash\") pod \"iptables-alerter-xkzc8\" (UID: \"06028e29-e135-48d5-aa5d-2c625009150d\") " pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475107    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-cni-netd\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475155    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysconfig\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475168    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06028e29-e135-48d5-aa5d-2c625009150d-host-slash\") pod \"iptables-alerter-xkzc8\" (UID: \"06028e29-e135-48d5-aa5d-2c625009150d\") " pod="openshift-network-operator/iptables-alerter-xkzc8"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475181    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-cnibin\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475208    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-socket-dir-parent\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475237    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-etc-selinux\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475227    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysconfig\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475272    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475269    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-multus-socket-dir-parent\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475293    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/571e6927-684b-4d97-b9ab-4d2581d5235a-hosts-file\") pod \"node-resolver-8g6wj\" (UID: \"571e6927-684b-4d97-b9ab-4d2581d5235a\") " pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475302    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-etc-selinux\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475339    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/571e6927-684b-4d97-b9ab-4d2581d5235a-hosts-file\") pod \"node-resolver-8g6wj\" (UID: \"571e6927-684b-4d97-b9ab-4d2581d5235a\") " pod="openshift-dns/node-resolver-8g6wj"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.475389    4948 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.475404    4948 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fcdccbdf7-r26s9: secret "image-registry-tls" not found
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.475463    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls podName:04f91be3-79d3-4f15-a7ba-f2d0bb249e02 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:53.975451643 +0000 UTC m=+1.794963609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls") pod "image-registry-6fcdccbdf7-r26s9" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02") : secret "image-registry-tls" not found
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475480    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-kubernetes\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475352    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-kubernetes\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475689    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-var-lib-kubelet\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475728    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-system-cni-dir\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475756    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475782    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-netns\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475790    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-var-lib-kubelet\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475807    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-node-log\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475809    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93430674-7eab-453f-a278-c8d352572441-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475798    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-system-cni-dir\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475843    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.475870    4948 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475868    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-node-log\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475891    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-netns\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475872    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34e89d20-b285-4246-8184-9fe736a2c6fb-kubelet-config\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475913    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/34e89d20-b285-4246-8184-9fe736a2c6fb-kubelet-config\") pod \"global-pull-secret-syncer-jk8sp\" (UID: \"34e89d20-b285-4246-8184-9fe736a2c6fb\") " pod="kube-system/global-pull-secret-syncer-jk8sp"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475868    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.475929    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs podName:86ced41b-f67d-4a69-9c48-81be43c75698 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:53.975913629 +0000 UTC m=+1.795425598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs") pod "router-default-7fc784755f-fpdq5" (UID: "86ced41b-f67d-4a69-9c48-81be43c75698") : secret "router-metrics-certs-default" not found
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475933    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-cnibin\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475949    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-systemd\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475981    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-multus-certs\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.475986    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-systemd\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476007    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476038    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-run-multus-certs\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476063    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-sys\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476088    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-cni-multus\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476105    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-etc-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.476072    4948 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476128    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476114    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-sys\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476147    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-cni-multus\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.476160    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls podName:d204b46f-c6a4-440f-8078-ce647d423f59 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:53.976145422 +0000 UTC m=+1.795657391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls") pod "dns-default-xchc6" (UID: "d204b46f-c6a4-440f-8078-ce647d423f59") : secret "dns-default-metrics-tls" not found
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476178    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-etc-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476194    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476201    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476221    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476244    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-cni-bin\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.476251    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle podName:86ced41b-f67d-4a69-9c48-81be43c75698 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:53.976240728 +0000 UTC m=+1.795752695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle") pod "router-default-7fc784755f-fpdq5" (UID: "86ced41b-f67d-4a69-9c48-81be43c75698") : configmap references non-existent config key: service-ca.crt
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476271    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-systemd-units\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476278    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-host-var-lib-cni-bin\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476295    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-systemd\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.476305    4948 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476319    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysctl-d\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476339    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-systemd-units\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.476351    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs podName:88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:53.976338734 +0000 UTC m=+1.795850725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs") pod "network-metrics-daemon-n7qt5" (UID: "88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c") : secret "metrics-daemon-secret" not found
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476387    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-run-systemd\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476426    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysctl-conf\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476439    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysctl-d\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476465    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-sys-fs\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476490    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476502    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-sys-fs\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476515    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-registration-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476547    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-etc-sysctl-conf\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476556    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476564    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34f5534a-5450-43a0-8d78-bc7e362bcfa9-registration-dir\") pod \"aws-ebs-csi-driver-node-cnqh5\" (UID: \"34f5534a-5450-43a0-8d78-bc7e362bcfa9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cnqh5"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.476577    4948 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.476587    4948 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79c6d8c76d-pvcm5: secret "image-registry-tls" not found
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476600    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7716064-3190-400e-be69-91ee32a14749-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rs9rh\" (UID: \"f7716064-3190-400e-be69-91ee32a14749\") " pod="openshift-multus/multus-additional-cni-plugins-rs9rh"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.476613    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls podName:90198fcb-a25b-4437-965b-750ede2da138 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:53.976603545 +0000 UTC m=+1.796115546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls") pod "image-registry-79c6d8c76d-pvcm5" (UID: "90198fcb-a25b-4437-965b-750ede2da138") : secret "image-registry-tls" not found
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476632    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-var-lib-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476654    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-run\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476668    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-host\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476670    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-var-lib-openvswitch\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476685    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476711    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-slash\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476721    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-run\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476732    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b502ddfa-b655-45b6-9b0f-e936f85a0fcb-host\") pod \"tuned-kbbkm\" (UID: \"b502ddfa-b655-45b6-9b0f-e936f85a0fcb\") " pod="openshift-cluster-node-tuning-operator/tuned-kbbkm"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476738    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-run-netns\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476766    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-hostroot\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.476719 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476771    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-slash\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.479160 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.476785    4948 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:53.479160 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476790    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-run-netns\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.479160 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476794    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:53.479160 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476812    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-kubelet\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.479160 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476817    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87b38c08-ae1d-4961-bd80-f0198dec4a22-hostroot\") pod \"multus-rt5dq\" (UID: \"87b38c08-ae1d-4961-bd80-f0198dec4a22\") " pod="openshift-multus/multus-rt5dq"
Oct 30 20:38:53.479160 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.476824    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls podName:86386c5c-e63e-4a97-a58e-ee79814a585f nodeName:}" failed. No retries permitted until 2026-10-30 20:38:53.976810941 +0000 UTC m=+1.796322937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-5pmqz" (UID: "86386c5c-e63e-4a97-a58e-ee79814a585f") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:53.479160 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.476836    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0-host-kubelet\") pod \"ovnkube-node-6nqrx\" (UID: \"d9f4ae35-3ffe-4d5d-b2a2-d32073d63bf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:53.479160 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.476878    4948 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:53.479160 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.476913    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls podName:93430674-7eab-453f-a278-c8d352572441 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:53.976903384 +0000 UTC m=+1.796415353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjcfz" (UID: "93430674-7eab-453f-a278-c8d352572441") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:53.504673 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.504645    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:53.560810 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.560782    4948 scope.go:122] "RemoveContainer" containerID="06135342ee3628b382371bbace43209766db17b7fa0070231425c40fbe4e46a3"
Oct 30 20:38:53.981339 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.981252    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:53.981339 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.981302    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:53.981578 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.981386    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:53.981578 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.981419    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:53.981578 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981439    4948 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:38:53.981578 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.981453    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:53.981578 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981461    4948 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:38:53.981578 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.981481    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:53.981578 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981465    4948 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:53.981578 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981518    4948 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fcdccbdf7-r26s9: secret "image-registry-tls" not found
Oct 30 20:38:53.981578 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981520    4948 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:38:53.981578 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981522    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert podName:2c88c202-657d-49fd-83af-da47476931a9 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.981485587 +0000 UTC m=+2.800997574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fx72n" (UID: "2c88c202-657d-49fd-83af-da47476931a9") : secret "networking-console-plugin-cert" not found
Oct 30 20:38:53.981578 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981583    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls podName:75581bb4-9213-4894-ad60-5cbe03c4ff6c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.981571488 +0000 UTC m=+2.801083460 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xpnhd" (UID: "75581bb4-9213-4894-ad60-5cbe03c4ff6c") : secret "samples-operator-tls" not found
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981584    4948 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981615    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls podName:04f91be3-79d3-4f15-a7ba-f2d0bb249e02 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.981606413 +0000 UTC m=+2.801118399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls") pod "image-registry-6fcdccbdf7-r26s9" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02") : secret "image-registry-tls" not found
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981651    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls podName:d204b46f-c6a4-440f-8078-ce647d423f59 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.981629514 +0000 UTC m=+2.801141495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls") pod "dns-default-xchc6" (UID: "d204b46f-c6a4-440f-8078-ce647d423f59") : secret "dns-default-metrics-tls" not found
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981673    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle podName:86ced41b-f67d-4a69-9c48-81be43c75698 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.981663428 +0000 UTC m=+2.801175396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle") pod "router-default-7fc784755f-fpdq5" (UID: "86ced41b-f67d-4a69-9c48-81be43c75698") : configmap references non-existent config key: service-ca.crt
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981692    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs podName:86ced41b-f67d-4a69-9c48-81be43c75698 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.981683488 +0000 UTC m=+2.801195488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs") pod "router-default-7fc784755f-fpdq5" (UID: "86ced41b-f67d-4a69-9c48-81be43c75698") : secret "router-metrics-certs-default" not found
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.981714    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.981762    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.981804    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981819    4948 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:53.981850    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981871    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs podName:88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.981861057 +0000 UTC m=+2.801373022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs") pod "network-metrics-daemon-n7qt5" (UID: "88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c") : secret "metrics-daemon-secret" not found
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981917    4948 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981923    4948 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981925    4948 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981941    4948 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79c6d8c76d-pvcm5: secret "image-registry-tls" not found
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981956    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls podName:86386c5c-e63e-4a97-a58e-ee79814a585f nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.981946099 +0000 UTC m=+2.801458096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-5pmqz" (UID: "86386c5c-e63e-4a97-a58e-ee79814a585f") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981971    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls podName:93430674-7eab-453f-a278-c8d352572441 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.981965124 +0000 UTC m=+2.801477129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjcfz" (UID: "93430674-7eab-453f-a278-c8d352572441") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:53.982063 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:53.981981    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls podName:90198fcb-a25b-4437-965b-750ede2da138 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:54.981976216 +0000 UTC m=+2.801488182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls") pod "image-registry-79c6d8c76d-pvcm5" (UID: "90198fcb-a25b-4437-965b-750ede2da138") : secret "image-registry-tls" not found
Oct 30 20:38:54.346112 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:54.346086    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/2.log"
Oct 30 20:38:54.346576 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:54.346560    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/1.log"
Oct 30 20:38:54.346613 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:54.346592    4948 generic.go:356] "Generic (PLEG): container finished" podID="9d262282-6f9c-4945-959d-81e9a9a12392" containerID="d7cc9d593d6e46d0f81fba4e5ef760d8544f5fcb69c9be100bd21cba40779fd6" exitCode=255
Oct 30 20:38:54.346691 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:54.346668    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq" event={"ID":"9d262282-6f9c-4945-959d-81e9a9a12392","Type":"ContainerDied","Data":"d7cc9d593d6e46d0f81fba4e5ef760d8544f5fcb69c9be100bd21cba40779fd6"}
Oct 30 20:38:54.346822 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:54.346719    4948 scope.go:122] "RemoveContainer" containerID="06135342ee3628b382371bbace43209766db17b7fa0070231425c40fbe4e46a3"
Oct 30 20:38:54.347152 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:54.347133    4948 scope.go:122] "RemoveContainer" containerID="d7cc9d593d6e46d0f81fba4e5ef760d8544f5fcb69c9be100bd21cba40779fd6"
Oct 30 20:38:54.347318 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.347294    4948 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-pjhmq_openshift-console-operator(9d262282-6f9c-4945-959d-81e9a9a12392)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq" podUID="9d262282-6f9c-4945-959d-81e9a9a12392"
Oct 30 20:38:54.525918 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:54.525890    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8g6wj_571e6927-684b-4d97-b9ab-4d2581d5235a/dns-node-resolver/0.log"
Oct 30 20:38:54.991257 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:54.991216    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:54.991257 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:54.991268    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:54.991542 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:54.991288    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:54.991542 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:54.991304    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:54.991542 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:54.991351    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:54.991542 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991396    4948 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 20:38:54.991542 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:54.991403    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:54.991542 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991398    4948 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:38:54.991542 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991455    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle podName:86ced41b-f67d-4a69-9c48-81be43c75698 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:56.991433133 +0000 UTC m=+4.810945121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle") pod "router-default-7fc784755f-fpdq5" (UID: "86ced41b-f67d-4a69-9c48-81be43c75698") : configmap references non-existent config key: service-ca.crt
Oct 30 20:38:54.991542 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991467    4948 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:54.991542 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991477    4948 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 20:38:54.991542 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991486    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls podName:d204b46f-c6a4-440f-8078-ce647d423f59 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:56.991477183 +0000 UTC m=+4.810989150 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls") pod "dns-default-xchc6" (UID: "d204b46f-c6a4-440f-8078-ce647d423f59") : secret "dns-default-metrics-tls" not found
Oct 30 20:38:54.991542 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991460    4948 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:54.991542 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991505    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs podName:86ced41b-f67d-4a69-9c48-81be43c75698 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:56.991497042 +0000 UTC m=+4.811009011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs") pod "router-default-7fc784755f-fpdq5" (UID: "86ced41b-f67d-4a69-9c48-81be43c75698") : secret "router-metrics-certs-default" not found
Oct 30 20:38:54.991542 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991513    4948 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79c6d8c76d-pvcm5: secret "image-registry-tls" not found
Oct 30 20:38:54.991542 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991518    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls podName:86386c5c-e63e-4a97-a58e-ee79814a585f nodeName:}" failed. No retries permitted until 2026-10-30 20:38:56.991512735 +0000 UTC m=+4.811024701 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-5pmqz" (UID: "86386c5c-e63e-4a97-a58e-ee79814a585f") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:54.991542 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991529    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs podName:88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:56.991524837 +0000 UTC m=+4.811036803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs") pod "network-metrics-daemon-n7qt5" (UID: "88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c") : secret "metrics-daemon-secret" not found
Oct 30 20:38:54.992035 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991557    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls podName:90198fcb-a25b-4437-965b-750ede2da138 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:56.991535181 +0000 UTC m=+4.811047147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls") pod "image-registry-79c6d8c76d-pvcm5" (UID: "90198fcb-a25b-4437-965b-750ede2da138") : secret "image-registry-tls" not found
Oct 30 20:38:54.992035 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:54.991589    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:54.992035 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:54.991629    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:54.992035 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:54.991647    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:54.992035 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991699    4948 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:54.992035 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:54.991710    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:54.992035 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991729    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls podName:93430674-7eab-453f-a278-c8d352572441 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:56.991716743 +0000 UTC m=+4.811228708 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjcfz" (UID: "93430674-7eab-453f-a278-c8d352572441") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:54.992035 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991741    4948 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:38:54.992035 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991771    4948 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:54.992035 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991786    4948 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fcdccbdf7-r26s9: secret "image-registry-tls" not found
Oct 30 20:38:54.992035 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991794    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert podName:2c88c202-657d-49fd-83af-da47476931a9 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:56.991775463 +0000 UTC m=+4.811287445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fx72n" (UID: "2c88c202-657d-49fd-83af-da47476931a9") : secret "networking-console-plugin-cert" not found
Oct 30 20:38:54.992035 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991806    4948 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:38:54.992035 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991815    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls podName:04f91be3-79d3-4f15-a7ba-f2d0bb249e02 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:56.991805963 +0000 UTC m=+4.811317953 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls") pod "image-registry-6fcdccbdf7-r26s9" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02") : secret "image-registry-tls" not found
Oct 30 20:38:54.992035 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:54.991845    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls podName:75581bb4-9213-4894-ad60-5cbe03c4ff6c nodeName:}" failed. No retries permitted until 2026-10-30 20:38:56.991829544 +0000 UTC m=+4.811341519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xpnhd" (UID: "75581bb4-9213-4894-ad60-5cbe03c4ff6c") : secret "samples-operator-tls" not found
Oct 30 20:38:55.351930 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:55.351906    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/2.log"
Oct 30 20:38:55.565566 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:55.565533    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:55.725981 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:55.725913    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-778mq_f0f30507-57cb-4145-bd0c-f44b3698d7ab/node-ca/0.log"
Oct 30 20:38:55.774301 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:55.774270    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:55.923771 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:55.923733    4948 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:38:55.924114 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:55.924097    4948 scope.go:122] "RemoveContainer" containerID="d7cc9d593d6e46d0f81fba4e5ef760d8544f5fcb69c9be100bd21cba40779fd6"
Oct 30 20:38:55.924281 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:55.924263    4948 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-pjhmq_openshift-console-operator(9d262282-6f9c-4945-959d-81e9a9a12392)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq" podUID="9d262282-6f9c-4945-959d-81e9a9a12392"
Oct 30 20:38:56.125633 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:56.125594    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gxp9z_2d040316-e799-40d0-b5ee-2a4351ca99bd/serve-healthcheck-canary/0.log"
Oct 30 20:38:56.526424 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:56.526328    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-49kcm_a531c68c-5ab5-408a-ae30-640a1bc4c8ab/migrator/0.log"
Oct 30 20:38:56.568148 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:56.568118    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:56.771706 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:56.771668    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:56.927746 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:56.927715    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4_aa1a36c1-6032-42fe-aec6-97d2cc67bc0c/kube-storage-version-migrator-operator/0.log"
Oct 30 20:38:56.973415 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:56.973382    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:57.010147 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.010104    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:38:57.010147 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.010152    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:38:57.010318 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.010193    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:38:57.010318 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.010221    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:57.010318 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.010248    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:57.010318 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.010276    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:57.010318 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010248    4948 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 20:38:57.010318 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.010306    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:38:57.010589 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.010337    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:38:57.010589 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010349    4948 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:38:57.010589 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010397    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert podName:2c88c202-657d-49fd-83af-da47476931a9 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:01.010352407 +0000 UTC m=+8.829864392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-fx72n" (UID: "2c88c202-657d-49fd-83af-da47476931a9") : secret "networking-console-plugin-cert" not found
Oct 30 20:38:57.010589 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010353    4948 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:57.010589 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010415    4948 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:38:57.010589 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010424    4948 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79c6d8c76d-pvcm5: secret "image-registry-tls" not found
Oct 30 20:38:57.010589 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010430    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls podName:75581bb4-9213-4894-ad60-5cbe03c4ff6c nodeName:}" failed. No retries permitted until 2026-10-30 20:39:01.010415767 +0000 UTC m=+8.829927732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xpnhd" (UID: "75581bb4-9213-4894-ad60-5cbe03c4ff6c") : secret "samples-operator-tls" not found
Oct 30 20:38:57.010589 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010423    4948 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fcdccbdf7-r26s9: secret "image-registry-tls" not found
Oct 30 20:38:57.010589 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010461    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls podName:90198fcb-a25b-4437-965b-750ede2da138 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:01.010450362 +0000 UTC m=+8.829962353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls") pod "image-registry-79c6d8c76d-pvcm5" (UID: "90198fcb-a25b-4437-965b-750ede2da138") : secret "image-registry-tls" not found
Oct 30 20:38:57.010589 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.010476    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:38:57.010589 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010484    4948 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 20:38:57.010589 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010523    4948 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:57.010589 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010492    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls podName:04f91be3-79d3-4f15-a7ba-f2d0bb249e02 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:01.010482584 +0000 UTC m=+8.829994566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls") pod "image-registry-6fcdccbdf7-r26s9" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02") : secret "image-registry-tls" not found
Oct 30 20:38:57.010589 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010294    4948 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 20:38:57.011141 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010626    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls podName:86386c5c-e63e-4a97-a58e-ee79814a585f nodeName:}" failed. No retries permitted until 2026-10-30 20:39:01.010604828 +0000 UTC m=+8.830116800 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-5pmqz" (UID: "86386c5c-e63e-4a97-a58e-ee79814a585f") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:38:57.011141 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010651    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs podName:88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c nodeName:}" failed. No retries permitted until 2026-10-30 20:39:01.010638872 +0000 UTC m=+8.830150843 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs") pod "network-metrics-daemon-n7qt5" (UID: "88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c") : secret "metrics-daemon-secret" not found
Oct 30 20:38:57.011141 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010668    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs podName:86ced41b-f67d-4a69-9c48-81be43c75698 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:01.010659564 +0000 UTC m=+8.830171543 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs") pod "router-default-7fc784755f-fpdq5" (UID: "86ced41b-f67d-4a69-9c48-81be43c75698") : secret "router-metrics-certs-default" not found
Oct 30 20:38:57.011141 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.010687    4948 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 20:38:57.011141 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.010715    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:38:57.011141 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010844    4948 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:57.011141 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:38:57.010903    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls podName:93430674-7eab-453f-a278-c8d352572441 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:01.010891073 +0000 UTC m=+8.830403052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjcfz" (UID: "93430674-7eab-453f-a278-c8d352572441") : secret "insights-runtime-extractor-tls" not found
Oct 30 20:38:57.011141 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.010945    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ced41b-f67d-4a69-9c48-81be43c75698-service-ca-bundle\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:38:57.012692 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.012673    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d204b46f-c6a4-440f-8078-ce647d423f59-metrics-tls\") pod \"dns-default-xchc6\" (UID: \"d204b46f-c6a4-440f-8078-ce647d423f59\") " pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:57.176829 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.176791    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:57.212516 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.212479    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:57.418605 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.418568    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:57.448354 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.448284    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xchc6"]
Oct 30 20:38:57.451417 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:38:57.451381    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd204b46f_c6a4_440f_8078_ce647d423f59.slice/crio-08df546fd21c35f2f61dd2aaa9e129395685ed6bd997a8843225e131fa928918 WatchSource:0}: Error finding container 08df546fd21c35f2f61dd2aaa9e129395685ed6bd997a8843225e131fa928918: Status 404 returned error can't find the container with id 08df546fd21c35f2f61dd2aaa9e129395685ed6bd997a8843225e131fa928918
Oct 30 20:38:57.453480 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.453464    4948 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:38:57.969962 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:57.969888    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:58.365335 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:58.365299    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xchc6" event={"ID":"d204b46f-c6a4-440f-8078-ce647d423f59","Type":"ContainerStarted","Data":"08df546fd21c35f2f61dd2aaa9e129395685ed6bd997a8843225e131fa928918"}
Oct 30 20:38:58.570336 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:58.570289    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:58.770999 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:58.770922    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:59.164979 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:59.164938    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:59.372656 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:59.370981    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:59.372656 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:59.372383    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xchc6" event={"ID":"d204b46f-c6a4-440f-8078-ce647d423f59","Type":"ContainerStarted","Data":"193da6d14ae00264c1270c73d95e63a97fad9294c0d8bac4867f3e8b10d5766f"}
Oct 30 20:38:59.372656 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:59.372486    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xchc6" event={"ID":"d204b46f-c6a4-440f-8078-ce647d423f59","Type":"ContainerStarted","Data":"cada2146f07d5fc91011c83bfb46c4bba3cfc72566e432f9c99f4ca38e6bd3d8"}
Oct 30 20:38:59.372988 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:59.372926    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xchc6"
Oct 30 20:38:59.472111 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:59.472087    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:38:59.962022 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:38:59.961990    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:00.573880 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:00.573847    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:00.775293 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:00.775241    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:01.050513 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.050484    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:39:01.050659 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.050519    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:39:01.050659 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.050543    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:39:01.050659 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.050563    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:39:01.050659 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.050589    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:39:01.050659 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.050608    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:39:01.050659 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:01.050636    4948 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 20:39:01.050948 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:01.050662    4948 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 20:39:01.050948 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:01.050639    4948 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:39:01.050948 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:01.050702    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs podName:88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c nodeName:}" failed. No retries permitted until 2026-10-30 20:39:09.050684254 +0000 UTC m=+16.870196238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs") pod "network-metrics-daemon-n7qt5" (UID: "88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c") : secret "metrics-daemon-secret" not found
Oct 30 20:39:01.050948 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:01.050706    4948 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 20:39:01.050948 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:01.050710    4948 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79c6d8c76d-pvcm5: secret "image-registry-tls" not found
Oct 30 20:39:01.050948 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:01.050722    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls podName:86386c5c-e63e-4a97-a58e-ee79814a585f nodeName:}" failed. No retries permitted until 2026-10-30 20:39:09.050713026 +0000 UTC m=+16.870224991 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-5pmqz" (UID: "86386c5c-e63e-4a97-a58e-ee79814a585f") : secret "cluster-monitoring-operator-tls" not found
Oct 30 20:39:01.050948 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:01.050721    4948 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fcdccbdf7-r26s9: secret "image-registry-tls" not found
Oct 30 20:39:01.050948 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:01.050747    4948 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 20:39:01.050948 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.050638    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:39:01.050948 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:01.050762    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls podName:04f91be3-79d3-4f15-a7ba-f2d0bb249e02 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:09.050754921 +0000 UTC m=+16.870266889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls") pod "image-registry-6fcdccbdf7-r26s9" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02") : secret "image-registry-tls" not found
Oct 30 20:39:01.050948 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:01.050781    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls podName:90198fcb-a25b-4437-965b-750ede2da138 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:09.050773636 +0000 UTC m=+16.870285644 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls") pod "image-registry-79c6d8c76d-pvcm5" (UID: "90198fcb-a25b-4437-965b-750ede2da138") : secret "image-registry-tls" not found
Oct 30 20:39:01.050948 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:01.050795    4948 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls podName:75581bb4-9213-4894-ad60-5cbe03c4ff6c nodeName:}" failed. No retries permitted until 2026-10-30 20:39:09.05078833 +0000 UTC m=+16.870300298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xpnhd" (UID: "75581bb4-9213-4894-ad60-5cbe03c4ff6c") : secret "samples-operator-tls" not found
Oct 30 20:39:01.050948 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.050829    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:39:01.053174 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.053155    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93430674-7eab-453f-a278-c8d352572441-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjcfz\" (UID: \"93430674-7eab-453f-a278-c8d352572441\") " pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:39:01.053247 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.053195    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86ced41b-f67d-4a69-9c48-81be43c75698-metrics-certs\") pod \"router-default-7fc784755f-fpdq5\" (UID: \"86ced41b-f67d-4a69-9c48-81be43c75698\") " pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:39:01.053387 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.053348    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c88c202-657d-49fd-83af-da47476931a9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-fx72n\" (UID: \"2c88c202-657d-49fd-83af-da47476931a9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:39:01.062994 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.062972    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:39:01.063711 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.063691    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n"
Oct 30 20:39:01.077885 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.077865    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kjcfz"
Oct 30 20:39:01.181403 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.181351    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:01.185089 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.185067    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:39:01.185466 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.185452    4948 scope.go:122] "RemoveContainer" containerID="d7cc9d593d6e46d0f81fba4e5ef760d8544f5fcb69c9be100bd21cba40779fd6"
Oct 30 20:39:01.185651 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:01.185630    4948 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-pjhmq_openshift-console-operator(9d262282-6f9c-4945-959d-81e9a9a12392)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq" podUID="9d262282-6f9c-4945-959d-81e9a9a12392"
Oct 30 20:39:01.351153 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.351128    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-fx72n"]
Oct 30 20:39:01.354047 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:39:01.354010    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c88c202_657d_49fd_83af_da47476931a9.slice/crio-c13126c09611f3e7f730e7c8ed5a97af89ba6a1d1de2ec31ba9c0343177fa7c0 WatchSource:0}: Error finding container c13126c09611f3e7f730e7c8ed5a97af89ba6a1d1de2ec31ba9c0343177fa7c0: Status 404 returned error can't find the container with id c13126c09611f3e7f730e7c8ed5a97af89ba6a1d1de2ec31ba9c0343177fa7c0
Oct 30 20:39:01.355241 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.355221    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7fc784755f-fpdq5"]
Oct 30 20:39:01.358053 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:39:01.358033    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86ced41b_f67d_4a69_9c48_81be43c75698.slice/crio-1308d763803b4e18643b0a5c744881456bc04343e32cd5a406410abb6ddf5050 WatchSource:0}: Error finding container 1308d763803b4e18643b0a5c744881456bc04343e32cd5a406410abb6ddf5050: Status 404 returned error can't find the container with id 1308d763803b4e18643b0a5c744881456bc04343e32cd5a406410abb6ddf5050
Oct 30 20:39:01.377557 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.377536    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kjcfz"]
Oct 30 20:39:01.380411 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.380388    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7fc784755f-fpdq5" event={"ID":"86ced41b-f67d-4a69-9c48-81be43c75698","Type":"ContainerStarted","Data":"1308d763803b4e18643b0a5c744881456bc04343e32cd5a406410abb6ddf5050"}
Oct 30 20:39:01.381386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.381345    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n" event={"ID":"2c88c202-657d-49fd-83af-da47476931a9","Type":"ContainerStarted","Data":"c13126c09611f3e7f730e7c8ed5a97af89ba6a1d1de2ec31ba9c0343177fa7c0"}
Oct 30 20:39:01.390225 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:39:01.390203    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93430674_7eab_453f_a278_c8d352572441.slice/crio-de509da071a427385321d4b31b29b9288697c0b7e653e91f4b2d2cc7525f2bb8 WatchSource:0}: Error finding container de509da071a427385321d4b31b29b9288697c0b7e653e91f4b2d2cc7525f2bb8: Status 404 returned error can't find the container with id de509da071a427385321d4b31b29b9288697c0b7e653e91f4b2d2cc7525f2bb8
Oct 30 20:39:01.391695 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.391676    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:01.650486 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.650384    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:01.983690 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:01.983618    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:02.334635 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:02.334610    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:39:02.386465 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:02.386430    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7fc784755f-fpdq5" event={"ID":"86ced41b-f67d-4a69-9c48-81be43c75698","Type":"ContainerStarted","Data":"a81cecfa4f1b8eb75d6dade350167c2ccec41c2bcd98cfc375823fc580ee2cdb"}
Oct 30 20:39:02.388162 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:02.388136    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kjcfz" event={"ID":"93430674-7eab-453f-a278-c8d352572441","Type":"ContainerStarted","Data":"e5a91d23ca5b685437f96d457a2c407d0c2a954c16dea833676aa1bc85a00bd8"}
Oct 30 20:39:02.388257 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:02.388182    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kjcfz" event={"ID":"93430674-7eab-453f-a278-c8d352572441","Type":"ContainerStarted","Data":"6d3cb46f2afe4accc410740d8cf9cbc9544862246cca3294e944aae2e157219b"}
Oct 30 20:39:02.388257 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:02.388201    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kjcfz" event={"ID":"93430674-7eab-453f-a278-c8d352572441","Type":"ContainerStarted","Data":"de509da071a427385321d4b31b29b9288697c0b7e653e91f4b2d2cc7525f2bb8"}
Oct 30 20:39:02.440185 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:02.440122    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:02.654105 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:02.654076    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:02.882917 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:02.882880    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:03.063520 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:03.063489    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:39:03.066302 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:03.066282    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:39:03.182514 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:03.182445    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:03.394018 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:03.393983    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-fx72n" event={"ID":"2c88c202-657d-49fd-83af-da47476931a9","Type":"ContainerStarted","Data":"c849108f97e0d37cb68ff12f5e369be3244a83cdcd3ff1a0499484c2956f74bc"}
Oct 30 20:39:03.399998 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:03.399976    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:03.485947 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:03.485871    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:39:03.486107 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:03.486093    4948 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:39:03.969777 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:03.969748    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:04.398902 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:04.398875    4948 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:39:04.398902 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:04.398893    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kjcfz" event={"ID":"93430674-7eab-453f-a278-c8d352572441","Type":"ContainerStarted","Data":"194e9fcbf2d5cabb6c80b2ff5fdbddb0e0735386029741a8ef1f096d59efaa1f"}
Oct 30 20:39:04.570937 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:04.570893    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:04.708082 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:04.708008    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:39:04.709262 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:04.709241    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7fc784755f-fpdq5"
Oct 30 20:39:04.767202 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:04.767178    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:05.168651 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:05.168609    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:05.287093 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:05.287062    4948 scope.go:122] "RemoveContainer" containerID="d7cc9d593d6e46d0f81fba4e5ef760d8544f5fcb69c9be100bd21cba40779fd6"
Oct 30 20:39:05.370196 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:05.370166    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:05.403728 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:05.403709    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 20:39:05.404111 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:05.404096    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/2.log"
Oct 30 20:39:05.404154 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:05.404128    4948 generic.go:356] "Generic (PLEG): container finished" podID="9d262282-6f9c-4945-959d-81e9a9a12392" containerID="c8e84c9a3ca242a56e714cb6563f6934b6d88209af12b462896f74f73ce9717f" exitCode=255
Oct 30 20:39:05.404219 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:05.404201    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq" event={"ID":"9d262282-6f9c-4945-959d-81e9a9a12392","Type":"ContainerDied","Data":"c8e84c9a3ca242a56e714cb6563f6934b6d88209af12b462896f74f73ce9717f"}
Oct 30 20:39:05.404262 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:05.404252    4948 scope.go:122] "RemoveContainer" containerID="d7cc9d593d6e46d0f81fba4e5ef760d8544f5fcb69c9be100bd21cba40779fd6"
Oct 30 20:39:05.404793 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:05.404776    4948 scope.go:122] "RemoveContainer" containerID="c8e84c9a3ca242a56e714cb6563f6934b6d88209af12b462896f74f73ce9717f"
Oct 30 20:39:05.404985 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:05.404965    4948 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-pjhmq_openshift-console-operator(9d262282-6f9c-4945-959d-81e9a9a12392)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq" podUID="9d262282-6f9c-4945-959d-81e9a9a12392"
Oct 30 20:39:05.773241 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:05.773165    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:05.924676 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:05.924643    4948 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:39:05.975624 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:05.975591    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:06.409817 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:06.409795    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 20:39:06.410330 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:06.410322    4948 scope.go:122] "RemoveContainer" containerID="c8e84c9a3ca242a56e714cb6563f6934b6d88209af12b462896f74f73ce9717f"
Oct 30 20:39:06.410518 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:06.410498    4948 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-pjhmq_openshift-console-operator(9d262282-6f9c-4945-959d-81e9a9a12392)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq" podUID="9d262282-6f9c-4945-959d-81e9a9a12392"
Oct 30 20:39:08.964339 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:08.964301    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fcdccbdf7-r26s9"]
Oct 30 20:39:08.964777 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:08.964502    4948 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9" podUID="04f91be3-79d3-4f15-a7ba-f2d0bb249e02"
Oct 30 20:39:09.128975 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.128942    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:39:09.129145 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.128993    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:39:09.129145 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.129111    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:39:09.129277 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.129149    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:39:09.129277 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.129173    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:39:09.131643 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.131618    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86386c5c-e63e-4a97-a58e-ee79814a585f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-5pmqz\" (UID: \"86386c5c-e63e-4a97-a58e-ee79814a585f\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:39:09.131776 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.131647    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls\") pod \"image-registry-6fcdccbdf7-r26s9\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") " pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:39:09.131776 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.131659    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls\") pod \"image-registry-79c6d8c76d-pvcm5\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") " pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:39:09.131776 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.131753    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c-metrics-certs\") pod \"network-metrics-daemon-n7qt5\" (UID: \"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c\") " pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:39:09.132064 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.132043    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75581bb4-9213-4894-ad60-5cbe03c4ff6c-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xpnhd\" (UID: \"75581bb4-9213-4894-ad60-5cbe03c4ff6c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:39:09.160515 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.160492    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"
Oct 30 20:39:09.161635 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.161613    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"
Oct 30 20:39:09.166424 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.166403    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7qt5"
Oct 30 20:39:09.177277 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.177254    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:39:09.194184 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.194103    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:09.377417 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.377390    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xchc6"
Oct 30 20:39:09.390252 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.390228    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:09.419446 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.419393    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:39:09.427337 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.427315    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:39:09.449332 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.449307    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n7qt5"]
Oct 30 20:39:09.450502 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.450318    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd"]
Oct 30 20:39:09.452850 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:39:09.452824    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ed2fe8_493e_4b3c_96a3_e7eeddd95a5c.slice/crio-8fb6a27999fcf5c7ff94f6e1bcac820954edb0ae17473acb720fef9df3c686b1 WatchSource:0}: Error finding container 8fb6a27999fcf5c7ff94f6e1bcac820954edb0ae17473acb720fef9df3c686b1: Status 404 returned error can't find the container with id 8fb6a27999fcf5c7ff94f6e1bcac820954edb0ae17473acb720fef9df3c686b1
Oct 30 20:39:09.456561 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.456536    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz"]
Oct 30 20:39:09.460166 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:39:09.460140    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86386c5c_e63e_4a97_a58e_ee79814a585f.slice/crio-88ac6d54f2df28344d8369fd08c22aa732fcebf3e12991df171c113ddc468653 WatchSource:0}: Error finding container 88ac6d54f2df28344d8369fd08c22aa732fcebf3e12991df171c113ddc468653: Status 404 returned error can't find the container with id 88ac6d54f2df28344d8369fd08c22aa732fcebf3e12991df171c113ddc468653
Oct 30 20:39:09.474295 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.474275    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79c6d8c76d-pvcm5"]
Oct 30 20:39:09.478196 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:39:09.478174    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90198fcb_a25b_4437_965b_750ede2da138.slice/crio-9c19516737a3b582eaa426f623d0dc47b3ad04959e990d3c44a51c27d1f3c0c8 WatchSource:0}: Error finding container 9c19516737a3b582eaa426f623d0dc47b3ad04959e990d3c44a51c27d1f3c0c8: Status 404 returned error can't find the container with id 9c19516737a3b582eaa426f623d0dc47b3ad04959e990d3c44a51c27d1f3c0c8
Oct 30 20:39:09.533919 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.533898    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-image-registry-private-configuration\") pod \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") "
Oct 30 20:39:09.534011 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.533933    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-ca-trust-extracted\") pod \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") "
Oct 30 20:39:09.534011 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.533961    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls\") pod \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") "
Oct 30 20:39:09.534011 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.533979    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-kube-api-access-9mjsj\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-kube-api-access-9mjsj\") pod \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") "
Oct 30 20:39:09.534011 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.533999    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-trusted-ca\") pod \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") "
Oct 30 20:39:09.534430 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.534049    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-installation-pull-secrets\") pod \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") "
Oct 30 20:39:09.534430 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.534103    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-certificates\") pod \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") "
Oct 30 20:39:09.534430 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.534152    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-bound-sa-token\") pod \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\" (UID: \"04f91be3-79d3-4f15-a7ba-f2d0bb249e02\") "
Oct 30 20:39:09.534582 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.534530    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-trusted-ca" pod "04f91be3-79d3-4f15-a7ba-f2d0bb249e02" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:39:09.534880 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.534814    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-ca-trust-extracted" pod "04f91be3-79d3-4f15-a7ba-f2d0bb249e02" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:39:09.534988 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.534890    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-certificates" pod "04f91be3-79d3-4f15-a7ba-f2d0bb249e02" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:39:09.536287 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.536265    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-image-registry-private-configuration" pod "04f91be3-79d3-4f15-a7ba-f2d0bb249e02" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:39:09.536594 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.536577    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-bound-sa-token" pod "04f91be3-79d3-4f15-a7ba-f2d0bb249e02" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:39:09.536754 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.536734    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-kube-api-access-9mjsj" pod "04f91be3-79d3-4f15-a7ba-f2d0bb249e02" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02"). InnerVolumeSpecName "kube-api-access-9mjsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:39:09.536961 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.536935    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls" pod "04f91be3-79d3-4f15-a7ba-f2d0bb249e02" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:39:09.537019 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.536978    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-installation-pull-secrets" pod "04f91be3-79d3-4f15-a7ba-f2d0bb249e02" (UID: "04f91be3-79d3-4f15-a7ba-f2d0bb249e02"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:39:09.635500 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.635466    4948 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-certificates\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:09.635500 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.635495    4948 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-bound-sa-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:09.635500 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.635506    4948 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-image-registry-private-configuration\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:09.635710 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.635515    4948 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-ca-trust-extracted\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:09.635710 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.635526    4948 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-registry-tls\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:09.635710 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.635535    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mjsj\" (UniqueName: \"kubernetes.io/projected/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-kube-api-access-9mjsj\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:09.635710 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.635544    4948 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-trusted-ca\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:09.635710 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:09.635553    4948 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04f91be3-79d3-4f15-a7ba-f2d0bb249e02-installation-pull-secrets\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:10.371949 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:10.371909    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nqrx"
Oct 30 20:39:10.425415 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:10.425381    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n7qt5" event={"ID":"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c","Type":"ContainerStarted","Data":"8fb6a27999fcf5c7ff94f6e1bcac820954edb0ae17473acb720fef9df3c686b1"}
Oct 30 20:39:10.427259 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:10.427199    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd" event={"ID":"75581bb4-9213-4894-ad60-5cbe03c4ff6c","Type":"ContainerStarted","Data":"a384fb6dd151911185aca47856c4b8322b75bc0124412e724d20b2e198ece140"}
Oct 30 20:39:10.429515 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:10.429484    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5" event={"ID":"90198fcb-a25b-4437-965b-750ede2da138","Type":"ContainerStarted","Data":"bdfb6d9b5f8bddea2a242bba8c58740ef09e07a9ea5717a36d373cb1f8c135af"}
Oct 30 20:39:10.429609 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:10.429532    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5" event={"ID":"90198fcb-a25b-4437-965b-750ede2da138","Type":"ContainerStarted","Data":"9c19516737a3b582eaa426f623d0dc47b3ad04959e990d3c44a51c27d1f3c0c8"}
Oct 30 20:39:10.430285 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:10.430261    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:39:10.432198 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:10.431681    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fcdccbdf7-r26s9"
Oct 30 20:39:10.432198 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:10.432096    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz" event={"ID":"86386c5c-e63e-4a97-a58e-ee79814a585f","Type":"ContainerStarted","Data":"88ac6d54f2df28344d8369fd08c22aa732fcebf3e12991df171c113ddc468653"}
Oct 30 20:39:10.487011 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:10.486984    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fcdccbdf7-r26s9"]
Oct 30 20:39:10.498184 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:10.498157    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6fcdccbdf7-r26s9"]
Oct 30 20:39:11.185746 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:11.185708    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:39:11.186170 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:11.186151    4948 scope.go:122] "RemoveContainer" containerID="c8e84c9a3ca242a56e714cb6563f6934b6d88209af12b462896f74f73ce9717f"
Oct 30 20:39:11.186400 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:11.186354    4948 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-pjhmq_openshift-console-operator(9d262282-6f9c-4945-959d-81e9a9a12392)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq" podUID="9d262282-6f9c-4945-959d-81e9a9a12392"
Oct 30 20:39:11.438784 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:11.438727    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n7qt5" event={"ID":"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c","Type":"ContainerStarted","Data":"7d4aef9c8fa165048fdce57828fc52a1fed41a9d700b953eb2f313cead276ac8"}
Oct 30 20:39:11.439144 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:11.438789    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n7qt5" event={"ID":"88ed2fe8-493e-4b3c-96a3-e7eeddd95a5c","Type":"ContainerStarted","Data":"9b70d79b67cfa4da17120206bee19028bb247d0583c7e2c8e1292c9ed363e909"}
Oct 30 20:39:11.829967 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:11.829890    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:12.034162 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:12.034124    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:12.229683 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:12.229652    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:12.291672 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:12.291646    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="04f91be3-79d3-4f15-a7ba-f2d0bb249e02" path="/var/lib/kubelet/pods/04f91be3-79d3-4f15-a7ba-f2d0bb249e02/volumes"
Oct 30 20:39:12.444809 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:12.444772    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd" event={"ID":"75581bb4-9213-4894-ad60-5cbe03c4ff6c","Type":"ContainerStarted","Data":"127e9ec8c75ebe5c7bbe013beae534618b404a597500b2c8aabb18a90e3003b7"}
Oct 30 20:39:12.445216 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:12.444832    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xpnhd" event={"ID":"75581bb4-9213-4894-ad60-5cbe03c4ff6c","Type":"ContainerStarted","Data":"062e822dbf7c54e2e33389c55fa516c1b5481e5bab192d21345adba4e0188618"}
Oct 30 20:39:12.446297 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:12.446269    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-5pmqz" event={"ID":"86386c5c-e63e-4a97-a58e-ee79814a585f","Type":"ContainerStarted","Data":"be38d613402916c725ddfd649a8d12ce44e2af87e85cf402b9df4bd48a6b9534"}
Oct 30 20:39:13.582872 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:13.582840    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:14.907637 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:14.907604    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:15.112040 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:15.112000    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:15.308950 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:15.308885    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:17.422623 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:17.422585    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:17.621629 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:17.621600    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:18.126288 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:18.126246    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:18.338309 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:18.338275    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:18.651817 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:18.651788    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:18.852649 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:18.852622    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:20.272526 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.272494    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:20.511507 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.511474    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:20.552942 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.552867    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t99w9"]
Oct 30 20:39:20.586742 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.586716    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.599723 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.599699    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 20:39:20.600588 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.600565    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 20:39:20.600648 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.600600    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rmftm\""
Oct 30 20:39:20.650813 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.650788    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 20:39:20.650923 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.650874    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 20:39:20.718212 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.718178    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2436dc6f-03e6-48ed-8123-4372ef40b545-node-exporter-tls\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.718212 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.718214    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2436dc6f-03e6-48ed-8123-4372ef40b545-root\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.718432 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.718234    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2436dc6f-03e6-48ed-8123-4372ef40b545-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.718432 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.718384    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2436dc6f-03e6-48ed-8123-4372ef40b545-metrics-client-ca\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.718432 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.718421    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2436dc6f-03e6-48ed-8123-4372ef40b545-sys\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.718592 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.718439    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2436dc6f-03e6-48ed-8123-4372ef40b545-node-exporter-wtmp\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.718592 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.718503    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2436dc6f-03e6-48ed-8123-4372ef40b545-node-exporter-accelerators-collector-config\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.718592 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.718552    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9l9z\" (UniqueName: \"kubernetes.io/projected/2436dc6f-03e6-48ed-8123-4372ef40b545-kube-api-access-d9l9z\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.718715 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.718613    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2436dc6f-03e6-48ed-8123-4372ef40b545-node-exporter-textfile\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.730772 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.730751    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7wl8g"
Oct 30 20:39:20.736355 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.736330    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:20.819662 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.819607    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2436dc6f-03e6-48ed-8123-4372ef40b545-node-exporter-textfile\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.819662 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.819651    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2436dc6f-03e6-48ed-8123-4372ef40b545-node-exporter-tls\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.819889 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.819674    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2436dc6f-03e6-48ed-8123-4372ef40b545-root\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.819889 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.819699    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2436dc6f-03e6-48ed-8123-4372ef40b545-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.819889 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.819751    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2436dc6f-03e6-48ed-8123-4372ef40b545-metrics-client-ca\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.819889 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.819775    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2436dc6f-03e6-48ed-8123-4372ef40b545-root\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.819889 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.819783    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2436dc6f-03e6-48ed-8123-4372ef40b545-sys\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.819889 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.819825    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2436dc6f-03e6-48ed-8123-4372ef40b545-sys\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.819889 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.819835    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2436dc6f-03e6-48ed-8123-4372ef40b545-node-exporter-wtmp\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.819889 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.819876    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2436dc6f-03e6-48ed-8123-4372ef40b545-node-exporter-accelerators-collector-config\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.820260 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.819906    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9l9z\" (UniqueName: \"kubernetes.io/projected/2436dc6f-03e6-48ed-8123-4372ef40b545-kube-api-access-d9l9z\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.820260 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.819947    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2436dc6f-03e6-48ed-8123-4372ef40b545-node-exporter-wtmp\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.820260 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.819992    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2436dc6f-03e6-48ed-8123-4372ef40b545-node-exporter-textfile\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.820455 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.820434    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2436dc6f-03e6-48ed-8123-4372ef40b545-metrics-client-ca\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.820508 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.820438    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2436dc6f-03e6-48ed-8123-4372ef40b545-node-exporter-accelerators-collector-config\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.821984 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.821963    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2436dc6f-03e6-48ed-8123-4372ef40b545-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.822089 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.822072    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2436dc6f-03e6-48ed-8123-4372ef40b545-node-exporter-tls\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.832236 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.832210    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9l9z\" (UniqueName: \"kubernetes.io/projected/2436dc6f-03e6-48ed-8123-4372ef40b545-kube-api-access-d9l9z\") pod \"node-exporter-t99w9\" (UID: \"2436dc6f-03e6-48ed-8123-4372ef40b545\") " pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.937213 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.937180    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t99w9"
Oct 30 20:39:20.969407 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:39:20.969381    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2436dc6f_03e6_48ed_8123_4372ef40b545.slice/crio-e42414214c6616cf375682b276d8801696ac055227455f0a6c9b5a16bb1a1569 WatchSource:0}: Error finding container e42414214c6616cf375682b276d8801696ac055227455f0a6c9b5a16bb1a1569: Status 404 returned error can't find the container with id e42414214c6616cf375682b276d8801696ac055227455f0a6c9b5a16bb1a1569
Oct 30 20:39:20.982529 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:20.982499    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:21.288321 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:21.288287    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:21.478235 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:21.478201    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t99w9" event={"ID":"2436dc6f-03e6-48ed-8123-4372ef40b545","Type":"ContainerStarted","Data":"e42414214c6616cf375682b276d8801696ac055227455f0a6c9b5a16bb1a1569"}
Oct 30 20:39:21.495533 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:21.495506    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:21.709096 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:21.709060    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:21.908771 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:21.908725    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:22.337238 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:22.337209    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qwmdw"
Oct 30 20:39:23.487512 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:23.487476    4948 generic.go:356] "Generic (PLEG): container finished" podID="2436dc6f-03e6-48ed-8123-4372ef40b545" containerID="46a8b8c540c0bc23e572ada92ef60aa8b463c42eab50e0845199c3c7259fce98" exitCode=0
Oct 30 20:39:23.487903 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:23.487553    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t99w9" event={"ID":"2436dc6f-03e6-48ed-8123-4372ef40b545","Type":"ContainerDied","Data":"46a8b8c540c0bc23e572ada92ef60aa8b463c42eab50e0845199c3c7259fce98"}
Oct 30 20:39:23.546073 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:23.546045    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:23.767796 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:23.767714    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:23.929583 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:23.929548    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:39:24.099516 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:24.099489    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:24.310416 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:24.310378    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:24.493858 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:24.493784    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t99w9" event={"ID":"2436dc6f-03e6-48ed-8123-4372ef40b545","Type":"ContainerStarted","Data":"ab06fdb1051a6701919031bc380ca9554e008eeadfb54440349bcf38e1ac1cde"}
Oct 30 20:39:24.493858 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:24.493836    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t99w9" event={"ID":"2436dc6f-03e6-48ed-8123-4372ef40b545","Type":"ContainerStarted","Data":"485f0a9fa8912bd58abebf49721c9b46847c7ae1dc13ff7c51748237237b40af"}
Oct 30 20:39:24.523020 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:24.522968    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t99w9" podStartSLOduration=3.005270801 podStartE2EDuration="4.522951408s" totalImagesPullingTime="1.438404091s" totalInitContainerRuntime="79.276516ms" isStatefulPod=true podCreationTimestamp="2026-10-30 20:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:24.52066546 +0000 UTC m=+32.340177448" watchObservedRunningTime="2026-10-30 20:39:24.522951408 +0000 UTC m=+32.342463582"
Oct 30 20:39:24.541901 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:24.541871    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:25.314908 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:25.314871    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:25.513963 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:25.513912    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:26.895686 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:26.895652    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:27.286966 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:27.286877    4948 scope.go:122] "RemoveContainer" containerID="c8e84c9a3ca242a56e714cb6563f6934b6d88209af12b462896f74f73ce9717f"
Oct 30 20:39:27.507512 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:27.507482    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 20:39:27.507679 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:27.507533    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq" event={"ID":"9d262282-6f9c-4945-959d-81e9a9a12392","Type":"ContainerStarted","Data":"d132bdcb2e150d883e9ce4945c1acecf71d1188cb1ac6490e7b8b98188c57416"}
Oct 30 20:39:27.507867 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:27.507850    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:39:27.667150 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:27.667117    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-pjhmq"
Oct 30 20:39:27.995081 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:27.995000    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:28.194909 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:28.194873    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:28.400788 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:28.400757    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:28.693907 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:28.693815    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:29.918038 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:29.917961    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:30.119424 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:30.119390    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:30.955787 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:30.955752    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79c6d8c76d-pvcm5"]
Oct 30 20:39:30.960392 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:30.960346    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:39:31.166014 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:31.165973    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:31.362398 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:31.362353    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:32.418148 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:32.418111    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:32.628088 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:32.628064    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:34.297806 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:34.297685    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:34.514540 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:34.514496    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:39.257988 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:39.257952    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:39.481086 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:39.481054    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:40.111145 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:40.111111    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:40.310335 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:40.310302    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:42.552313 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:42.552273    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:42.787814 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:42.787786    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:42.993626 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:42.993593    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:43.194691 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:43.194660    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:43.417857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:43.417833    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:47.414890 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:47.414849    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:47.614034 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:47.613995    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:53.918976 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:53.918938    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:53.927913 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:53.927879    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:39:54.117277 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:54.117245    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:55.714744 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:55.714699    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:55.926891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:55.926844    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:55.976816 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:55.976735    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5" podUID="90198fcb-a25b-4437-965b-750ede2da138" containerName="registry" containerID="cri-o://bdfb6d9b5f8bddea2a242bba8c58740ef09e07a9ea5717a36d373cb1f8c135af" gracePeriod=30
Oct 30 20:39:56.223122 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.223101    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:39:56.289965 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.289906    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-image-registry-private-configuration\") pod \"90198fcb-a25b-4437-965b-750ede2da138\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") "
Oct 30 20:39:56.289965 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.289949    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-trusted-ca\") pod \"90198fcb-a25b-4437-965b-750ede2da138\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") "
Oct 30 20:39:56.290106 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.289979    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/90198fcb-a25b-4437-965b-750ede2da138-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90198fcb-a25b-4437-965b-750ede2da138-ca-trust-extracted\") pod \"90198fcb-a25b-4437-965b-750ede2da138\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") "
Oct 30 20:39:56.290106 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.290028    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-bound-sa-token\") pod \"90198fcb-a25b-4437-965b-750ede2da138\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") "
Oct 30 20:39:56.290106 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.290046    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-installation-pull-secrets\") pod \"90198fcb-a25b-4437-965b-750ede2da138\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") "
Oct 30 20:39:56.290106 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.290076    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls\") pod \"90198fcb-a25b-4437-965b-750ede2da138\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") "
Oct 30 20:39:56.290297 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.290108    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-kube-api-access-l45ml\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-kube-api-access-l45ml\") pod \"90198fcb-a25b-4437-965b-750ede2da138\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") "
Oct 30 20:39:56.290297 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.290154    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-registry-certificates\") pod \"90198fcb-a25b-4437-965b-750ede2da138\" (UID: \"90198fcb-a25b-4437-965b-750ede2da138\") "
Oct 30 20:39:56.290958 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.290901    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-trusted-ca" pod "90198fcb-a25b-4437-965b-750ede2da138" (UID: "90198fcb-a25b-4437-965b-750ede2da138"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:39:56.291292 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.291241    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-registry-certificates" pod "90198fcb-a25b-4437-965b-750ede2da138" (UID: "90198fcb-a25b-4437-965b-750ede2da138"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:39:56.292974 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.292891    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-installation-pull-secrets" pod "90198fcb-a25b-4437-965b-750ede2da138" (UID: "90198fcb-a25b-4437-965b-750ede2da138"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:39:56.293112 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.293090    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-bound-sa-token" pod "90198fcb-a25b-4437-965b-750ede2da138" (UID: "90198fcb-a25b-4437-965b-750ede2da138"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:39:56.293189 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.293105    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-image-registry-private-configuration" pod "90198fcb-a25b-4437-965b-750ede2da138" (UID: "90198fcb-a25b-4437-965b-750ede2da138"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:39:56.293189 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.293149    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls" pod "90198fcb-a25b-4437-965b-750ede2da138" (UID: "90198fcb-a25b-4437-965b-750ede2da138"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:39:56.293189 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.293184    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-kube-api-access-l45ml" pod "90198fcb-a25b-4437-965b-750ede2da138" (UID: "90198fcb-a25b-4437-965b-750ede2da138"). InnerVolumeSpecName "kube-api-access-l45ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:39:56.297149 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.297128    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90198fcb-a25b-4437-965b-750ede2da138-ca-trust-extracted" pod "90198fcb-a25b-4437-965b-750ede2da138" (UID: "90198fcb-a25b-4437-965b-750ede2da138"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:39:56.390940 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.390915    4948 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-registry-certificates\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:56.391048 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.390958    4948 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-image-registry-private-configuration\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:56.391048 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.390987    4948 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90198fcb-a25b-4437-965b-750ede2da138-trusted-ca\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:56.391048 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.391005    4948 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90198fcb-a25b-4437-965b-750ede2da138-ca-trust-extracted\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:56.391048 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.391020    4948 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-bound-sa-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:56.391048 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.391034    4948 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90198fcb-a25b-4437-965b-750ede2da138-installation-pull-secrets\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:56.391216 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.391049    4948 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-registry-tls\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:56.391216 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.391063    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l45ml\" (UniqueName: \"kubernetes.io/projected/90198fcb-a25b-4437-965b-750ede2da138-kube-api-access-l45ml\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:56.620779 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.620750    4948 generic.go:356] "Generic (PLEG): container finished" podID="90198fcb-a25b-4437-965b-750ede2da138" containerID="bdfb6d9b5f8bddea2a242bba8c58740ef09e07a9ea5717a36d373cb1f8c135af" exitCode=0
Oct 30 20:39:56.620887 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.620799    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5"
Oct 30 20:39:56.620887 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.620838    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5" event={"ID":"90198fcb-a25b-4437-965b-750ede2da138","Type":"ContainerDied","Data":"bdfb6d9b5f8bddea2a242bba8c58740ef09e07a9ea5717a36d373cb1f8c135af"}
Oct 30 20:39:56.620966 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.620893    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c6d8c76d-pvcm5" event={"ID":"90198fcb-a25b-4437-965b-750ede2da138","Type":"ContainerDied","Data":"9c19516737a3b582eaa426f623d0dc47b3ad04959e990d3c44a51c27d1f3c0c8"}
Oct 30 20:39:56.620966 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.620915    4948 scope.go:122] "RemoveContainer" containerID="bdfb6d9b5f8bddea2a242bba8c58740ef09e07a9ea5717a36d373cb1f8c135af"
Oct 30 20:39:56.630030 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.630012    4948 scope.go:122] "RemoveContainer" containerID="bdfb6d9b5f8bddea2a242bba8c58740ef09e07a9ea5717a36d373cb1f8c135af"
Oct 30 20:39:56.630326 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:39:56.630304    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdfb6d9b5f8bddea2a242bba8c58740ef09e07a9ea5717a36d373cb1f8c135af\": container with ID starting with bdfb6d9b5f8bddea2a242bba8c58740ef09e07a9ea5717a36d373cb1f8c135af not found: ID does not exist" containerID="bdfb6d9b5f8bddea2a242bba8c58740ef09e07a9ea5717a36d373cb1f8c135af"
Oct 30 20:39:56.630428 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.630335    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdfb6d9b5f8bddea2a242bba8c58740ef09e07a9ea5717a36d373cb1f8c135af"} err="failed to get container status \"bdfb6d9b5f8bddea2a242bba8c58740ef09e07a9ea5717a36d373cb1f8c135af\": rpc error: code = NotFound desc = could not find container \"bdfb6d9b5f8bddea2a242bba8c58740ef09e07a9ea5717a36d373cb1f8c135af\": container with ID starting with bdfb6d9b5f8bddea2a242bba8c58740ef09e07a9ea5717a36d373cb1f8c135af not found: ID does not exist"
Oct 30 20:39:56.642624 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.642594    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79c6d8c76d-pvcm5"]
Oct 30 20:39:56.650898 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:56.650876    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79c6d8c76d-pvcm5"]
Oct 30 20:39:57.321393 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:57.321338    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:57.525502 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:57.525471    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:58.291624 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:58.291545    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="90198fcb-a25b-4437-965b-750ede2da138" path="/var/lib/kubelet/pods/90198fcb-a25b-4437-965b-750ede2da138/volumes"
Oct 30 20:39:58.631349 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:58.631320    4948 generic.go:356] "Generic (PLEG): container finished" podID="21b1d440-8b5c-4e0b-b3bf-e74befdce48e" containerID="b50bc4cdbabeb98d558c36549f9d82c713b67cfae4a7f8e0da7f37579cdcc00d" exitCode=0
Oct 30 20:39:58.631711 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:58.631401    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-sxgrn" event={"ID":"21b1d440-8b5c-4e0b-b3bf-e74befdce48e","Type":"ContainerDied","Data":"b50bc4cdbabeb98d558c36549f9d82c713b67cfae4a7f8e0da7f37579cdcc00d"}
Oct 30 20:39:58.631752 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:58.631712    4948 scope.go:122] "RemoveContainer" containerID="b50bc4cdbabeb98d558c36549f9d82c713b67cfae4a7f8e0da7f37579cdcc00d"
Oct 30 20:39:58.925163 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:58.925055    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:59.169243 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:59.169206    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:59.384261 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:59.384227    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:59.637507 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:39:59.637435    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-sxgrn" event={"ID":"21b1d440-8b5c-4e0b-b3bf-e74befdce48e","Type":"ContainerStarted","Data":"b963b6cdb3af135833de2b781cf5fabd2319d738592d5ab6520b6d63d888974f"}
Oct 30 20:40:13.451838 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:40:13.451795    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:13.648515 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:40:13.648478    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:17.426316 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:40:17.426267    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:17.621185 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:40:17.621151    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:23.927087 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:40:23.927053    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:40:28.047057 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:40:28.047029    4948 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1a36c1_6032_42fe_aec6_97d2cc67bc0c.slice/crio-conmon-cabd5efd22623e42a0f0189d048ced248b4b08fd725486283d324df7dda61d2b.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 20:40:28.754715 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:40:28.754682    4948 generic.go:356] "Generic (PLEG): container finished" podID="aa1a36c1-6032-42fe-aec6-97d2cc67bc0c" containerID="cabd5efd22623e42a0f0189d048ced248b4b08fd725486283d324df7dda61d2b" exitCode=0
Oct 30 20:40:28.754871 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:40:28.754763    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4" event={"ID":"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c","Type":"ContainerDied","Data":"cabd5efd22623e42a0f0189d048ced248b4b08fd725486283d324df7dda61d2b"}
Oct 30 20:40:28.755149 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:40:28.755130    4948 scope.go:122] "RemoveContainer" containerID="cabd5efd22623e42a0f0189d048ced248b4b08fd725486283d324df7dda61d2b"
Oct 30 20:40:28.756764 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:40:28.756734    4948 generic.go:356] "Generic (PLEG): container finished" podID="b2a12cab-f546-4344-8460-3f967e181eeb" containerID="1705e6fcb2996d2c62223b59879fc373d51c933d97bd137384e1eaaf1017f666" exitCode=0
Oct 30 20:40:28.756829 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:40:28.756789    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m" event={"ID":"b2a12cab-f546-4344-8460-3f967e181eeb","Type":"ContainerDied","Data":"1705e6fcb2996d2c62223b59879fc373d51c933d97bd137384e1eaaf1017f666"}
Oct 30 20:40:28.757121 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:40:28.757104    4948 scope.go:122] "RemoveContainer" containerID="1705e6fcb2996d2c62223b59879fc373d51c933d97bd137384e1eaaf1017f666"
Oct 30 20:40:29.763377 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:40:29.763334    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hjtb4" event={"ID":"aa1a36c1-6032-42fe-aec6-97d2cc67bc0c","Type":"ContainerStarted","Data":"7baa5dd2e21c98ddd2733401e07f5090aa1fc83792ce4f21b60f6f056046881f"}
Oct 30 20:40:29.765492 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:40:29.765463    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-frc7m" event={"ID":"b2a12cab-f546-4344-8460-3f967e181eeb","Type":"ContainerStarted","Data":"c6868f624e4663092fccb07747edb5afffcf226d111c2cf6413c42f748f03bb3"}
Oct 30 20:40:42.616604 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:40:42.616564    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:53.926058 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:40:53.926021    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:41:23.929326 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:41:23.929281    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:41:25.845797 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:25.845754    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:26.043830 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:26.043790    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:42.678767 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:42.678716    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:46.672457 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:46.672419    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:46.930232 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:46.930127    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:48.198744 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.198711    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"]
Oct 30 20:41:48.199139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.199030    4948 cpu_manager.go:414] "containerMap: removing container" podUID="90198fcb-a25b-4437-965b-750ede2da138" containerName="registry"
Oct 30 20:41:48.199139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.199042    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="90198fcb-a25b-4437-965b-750ede2da138" containerName="registry"
Oct 30 20:41:48.199139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.199130    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="90198fcb-a25b-4437-965b-750ede2da138" containerName="registry"
Oct 30 20:41:48.202093 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.202075    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.205808 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.205785    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 20:41:48.205937 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.205842    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 20:41:48.206043 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.206024    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 20:41:48.206100 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.206027    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 20:41:48.206100 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.206080    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fnh57\""
Oct 30 20:41:48.214673 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.214636    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"]
Oct 30 20:41:48.252687 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.252663    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.252781 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.252703    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.252781 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.252733    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.252854 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.252822    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gcgv\" (UniqueName: \"kubernetes.io/projected/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-kube-api-access-5gcgv\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.252854 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.252843    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.252916 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.252865    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.252916 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.252884    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.316282 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.316258    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:48.353410 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.353387    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.353503 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.353437    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.353503 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.353462    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.353503 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.353488    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gcgv\" (UniqueName: \"kubernetes.io/projected/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-kube-api-access-5gcgv\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.353667 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.353639    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.353754 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.353733    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.353859 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.353837    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.354256 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.354232    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.355790 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.355771    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.356131 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.356111    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.356314 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.356297    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.356314 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.356310    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.365477 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.365456    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.365799 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.365780    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gcgv\" (UniqueName: \"kubernetes.io/projected/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-kube-api-access-5gcgv\") pod \"istiod-openshift-gateway-7876bfcb74-q7qmh\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.513785 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.513730    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:48.517526 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.517500    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:48.794264 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:48.794188    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"]
Oct 30 20:41:48.797946 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:41:48.797911    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1274c3f_3f8c_45b9_91e6_b81344a1b0bc.slice/crio-e005c181c06ada07010680d8ac15780d01bd5ebf11932b28698821cfec0a5a31 WatchSource:0}: Error finding container e005c181c06ada07010680d8ac15780d01bd5ebf11932b28698821cfec0a5a31: Status 404 returned error can't find the container with id e005c181c06ada07010680d8ac15780d01bd5ebf11932b28698821cfec0a5a31
Oct 30 20:41:49.055696 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:49.055632    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh" event={"ID":"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc","Type":"ContainerStarted","Data":"e005c181c06ada07010680d8ac15780d01bd5ebf11932b28698821cfec0a5a31"}
Oct 30 20:41:49.659060 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:49.659020    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:51.887696 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:51.887668    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:41:51.887953 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:51.887728    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:41:52.069696 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:52.069667    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh" event={"ID":"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc","Type":"ContainerStarted","Data":"43ae10bde7628d236b16f0b91a382faad3949d81ce1f566c0a80e8ee931653d2"}
Oct 30 20:41:52.069872 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:52.069839    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:52.071123 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:52.071092    4948 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-q7qmh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:41:52.071235 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:52.071147    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh" podUID="c1274c3f-3f8c-45b9-91e6-b81344a1b0bc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:41:52.095632 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:52.095585    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh" podStartSLOduration=1.008551907 podStartE2EDuration="4.095568879s" totalImagesPullingTime="3.087016972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:41:52.093468831 +0000 UTC m=+179.912980821" watchObservedRunningTime="2026-10-30 20:41:52.095568879 +0000 UTC m=+179.915080869"
Oct 30 20:41:52.559874 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:52.559838    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:52.779495 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:52.779463    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:53.074574 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:53.074546    4948 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-q7qmh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:41:53.074912 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:53.074593    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh" podUID="c1274c3f-3f8c-45b9-91e6-b81344a1b0bc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:41:53.786703 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:53.786668    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:53.925487 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:41:53.925454    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:41:54.016473 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:54.016352    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:56.075526 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:56.075492    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:41:56.428043 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:56.428012    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:59.288970 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:59.288922    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:59.488041 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:41:59.488010    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:23.925978 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:42:23.925940    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:42:29.257139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:29.257107    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:29.507310 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:29.507225    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:29.964236 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:29.964198    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:30.044803 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.044764    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"]
Oct 30 20:42:30.049966 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.049944    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.089111 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.089080    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 20:42:30.089256 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.089135    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 20:42:30.089256 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.089224    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 30 20:42:30.089256 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.089226    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 30 20:42:30.089484 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.089229    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-hvr5z\""
Oct 30 20:42:30.089484 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.089253    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 30 20:42:30.091458 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.091435    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"]
Oct 30 20:42:30.154756 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.154728    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b441dedd-43a1-42c2-8750-55fafae3e3d8-metrics-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.154756 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.154760    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b441dedd-43a1-42c2-8750-55fafae3e3d8-manifests\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.154947 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.154790    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bbzt\" (UniqueName: \"kubernetes.io/projected/b441dedd-43a1-42c2-8750-55fafae3e3d8-kube-api-access-2bbzt\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.154947 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.154929    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b441dedd-43a1-42c2-8750-55fafae3e3d8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.155010 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.154958    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b441dedd-43a1-42c2-8750-55fafae3e3d8-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.155010 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.154995    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b441dedd-43a1-42c2-8750-55fafae3e3d8-tmp\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.256351 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.256273    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b441dedd-43a1-42c2-8750-55fafae3e3d8-metrics-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.256351 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.256306    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b441dedd-43a1-42c2-8750-55fafae3e3d8-manifests\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.256351 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.256333    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bbzt\" (UniqueName: \"kubernetes.io/projected/b441dedd-43a1-42c2-8750-55fafae3e3d8-kube-api-access-2bbzt\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.256616 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.256390    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b441dedd-43a1-42c2-8750-55fafae3e3d8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.256616 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.256410    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b441dedd-43a1-42c2-8750-55fafae3e3d8-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.256616 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.256439    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b441dedd-43a1-42c2-8750-55fafae3e3d8-tmp\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.256775 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.256754    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b441dedd-43a1-42c2-8750-55fafae3e3d8-manifests\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.258807 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.258783    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b441dedd-43a1-42c2-8750-55fafae3e3d8-tmp\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.259106 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.258987    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b441dedd-43a1-42c2-8750-55fafae3e3d8-metrics-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.259106 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.259022    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b441dedd-43a1-42c2-8750-55fafae3e3d8-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.259106 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.259045    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b441dedd-43a1-42c2-8750-55fafae3e3d8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.269004 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.268978    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:30.269164 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.269145    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bbzt\" (UniqueName: \"kubernetes.io/projected/b441dedd-43a1-42c2-8750-55fafae3e3d8-kube-api-access-2bbzt\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8nd7j\" (UID: \"b441dedd-43a1-42c2-8750-55fafae3e3d8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.362324 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.362295    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:30.538015 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.537941    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:30.664408 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.664380    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"]
Oct 30 20:42:30.666016 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:42:30.665989    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb441dedd_43a1_42c2_8750_55fafae3e3d8.slice/crio-6c4e265cf535956674c00d0a34807d54b975c398884aaf8671a5105cddb29733 WatchSource:0}: Error finding container 6c4e265cf535956674c00d0a34807d54b975c398884aaf8671a5105cddb29733: Status 404 returned error can't find the container with id 6c4e265cf535956674c00d0a34807d54b975c398884aaf8671a5105cddb29733
Oct 30 20:42:30.765953 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:30.765916    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:31.223698 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:31.223550    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j" event={"ID":"b441dedd-43a1-42c2-8750-55fafae3e3d8","Type":"ContainerStarted","Data":"6c4e265cf535956674c00d0a34807d54b975c398884aaf8671a5105cddb29733"}
Oct 30 20:42:31.371395 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:31.371345    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:32.710937 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:32.710890    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:33.019032 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:33.018951    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:33.632167 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:33.632081    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:34.238129 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:34.238044    4948 generic.go:356] "Generic (PLEG): container finished" podID="b441dedd-43a1-42c2-8750-55fafae3e3d8" containerID="d6cb9d8af5c5a9b08a7dce3bd934ab089f1f45fbe32705b63f3e361ab49c1c94" exitCode=0
Oct 30 20:42:34.238129 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:34.238111    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j" event={"ID":"b441dedd-43a1-42c2-8750-55fafae3e3d8","Type":"ContainerDied","Data":"d6cb9d8af5c5a9b08a7dce3bd934ab089f1f45fbe32705b63f3e361ab49c1c94"}
Oct 30 20:42:35.243799 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:35.243762    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j" event={"ID":"b441dedd-43a1-42c2-8750-55fafae3e3d8","Type":"ContainerStarted","Data":"d9fd5fe2311b0c0559c458a284653d8304c34868eb01098bc64eac34167f7c67"}
Oct 30 20:42:35.244191 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:35.243867    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:36.293134 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:36.293101    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:36.528370 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:36.528337    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:40.055461 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:40.055423    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:40.470761 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:40.470722    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:40.703810 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:40.703774    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:42.701034 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:42.701001    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:42.915317 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:42.915286    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:45.140266 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:45.140227    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:45.508776 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:45.508702    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:45.783583 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:45.783505    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:46.249594 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:46.249566    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j"
Oct 30 20:42:46.297522 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:46.297479    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8nd7j" podStartSLOduration=13.662178817000001 podStartE2EDuration="17.297464922s" totalImagesPullingTime="3.147313152s" totalInitContainerRuntime="487.972953ms" isStatefulPod=false podCreationTimestamp="2026-10-30 20:42:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:42:35.307743649 +0000 UTC m=+223.127255634" watchObservedRunningTime="2026-10-30 20:42:46.297464922 +0000 UTC m=+234.116976906"
Oct 30 20:42:46.418768 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:46.418734    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:47.411707 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:47.411677    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:51.743925 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:51.743888    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:53.570295 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:53.570265    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:53.878712 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:53.878675    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:53.926153 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:42:53.926118    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:42:54.634858 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:54.634827    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:55.244290 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:55.244256    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:55.618842 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:55.618803    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:55.945494 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:55.945411    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:57.928674 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:57.928643    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:58.144109 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:42:58.144081    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:00.487161 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:00.487129    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:00.734424 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:00.734389    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:03.423680 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:03.423650    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:03.655165 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:03.655125    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:03.867959 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:03.867921    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:05.556705 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:05.556674    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:05.767614 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:05.767578    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:06.076206 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.076175    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:06.247208 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.247183    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85bbc4c96f-dkcgw"]
Oct 30 20:43:06.250424 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.250405    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-dkcgw"
Oct 30 20:43:06.266804 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.266780    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85bbc4c96f-dkcgw"]
Oct 30 20:43:06.273570 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.273543    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Oct 30 20:43:06.273673 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.273608    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Oct 30 20:43:06.273673 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.273648    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zzbjx\""
Oct 30 20:43:06.339058 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.339030    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:06.435452 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.435427    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26cc8cba-9eff-426b-b98a-c88816f103c7-tls-certs\") pod \"kube-auth-proxy-85bbc4c96f-dkcgw\" (UID: \"26cc8cba-9eff-426b-b98a-c88816f103c7\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-dkcgw"
Oct 30 20:43:06.435601 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.435484    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26cc8cba-9eff-426b-b98a-c88816f103c7-tmp\") pod \"kube-auth-proxy-85bbc4c96f-dkcgw\" (UID: \"26cc8cba-9eff-426b-b98a-c88816f103c7\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-dkcgw"
Oct 30 20:43:06.435601 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.435582    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfcvm\" (UniqueName: \"kubernetes.io/projected/26cc8cba-9eff-426b-b98a-c88816f103c7-kube-api-access-tfcvm\") pod \"kube-auth-proxy-85bbc4c96f-dkcgw\" (UID: \"26cc8cba-9eff-426b-b98a-c88816f103c7\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-dkcgw"
Oct 30 20:43:06.536825 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.536794    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26cc8cba-9eff-426b-b98a-c88816f103c7-tls-certs\") pod \"kube-auth-proxy-85bbc4c96f-dkcgw\" (UID: \"26cc8cba-9eff-426b-b98a-c88816f103c7\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-dkcgw"
Oct 30 20:43:06.537053 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.537033    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26cc8cba-9eff-426b-b98a-c88816f103c7-tmp\") pod \"kube-auth-proxy-85bbc4c96f-dkcgw\" (UID: \"26cc8cba-9eff-426b-b98a-c88816f103c7\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-dkcgw"
Oct 30 20:43:06.537185 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.537171    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfcvm\" (UniqueName: \"kubernetes.io/projected/26cc8cba-9eff-426b-b98a-c88816f103c7-kube-api-access-tfcvm\") pod \"kube-auth-proxy-85bbc4c96f-dkcgw\" (UID: \"26cc8cba-9eff-426b-b98a-c88816f103c7\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-dkcgw"
Oct 30 20:43:06.540679 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.540643    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26cc8cba-9eff-426b-b98a-c88816f103c7-tls-certs\") pod \"kube-auth-proxy-85bbc4c96f-dkcgw\" (UID: \"26cc8cba-9eff-426b-b98a-c88816f103c7\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-dkcgw"
Oct 30 20:43:06.540800 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.540781    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26cc8cba-9eff-426b-b98a-c88816f103c7-tmp\") pod \"kube-auth-proxy-85bbc4c96f-dkcgw\" (UID: \"26cc8cba-9eff-426b-b98a-c88816f103c7\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-dkcgw"
Oct 30 20:43:06.552305 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.552271    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfcvm\" (UniqueName: \"kubernetes.io/projected/26cc8cba-9eff-426b-b98a-c88816f103c7-kube-api-access-tfcvm\") pod \"kube-auth-proxy-85bbc4c96f-dkcgw\" (UID: \"26cc8cba-9eff-426b-b98a-c88816f103c7\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-dkcgw"
Oct 30 20:43:06.566817 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.566797    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-dkcgw"
Oct 30 20:43:06.659142 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.659114    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:06.861915 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.861891    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85bbc4c96f-dkcgw"]
Oct 30 20:43:06.864443 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:43:06.864417    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26cc8cba_9eff_426b_b98a_c88816f103c7.slice/crio-759fbca76eddb6e823e54de5d3e6679306c635abf8cf30bf24b2fc9b040d4fd3 WatchSource:0}: Error finding container 759fbca76eddb6e823e54de5d3e6679306c635abf8cf30bf24b2fc9b040d4fd3: Status 404 returned error can't find the container with id 759fbca76eddb6e823e54de5d3e6679306c635abf8cf30bf24b2fc9b040d4fd3
Oct 30 20:43:06.886117 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:06.886096    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:07.371301 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:07.371260    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-dkcgw" event={"ID":"26cc8cba-9eff-426b-b98a-c88816f103c7","Type":"ContainerStarted","Data":"759fbca76eddb6e823e54de5d3e6679306c635abf8cf30bf24b2fc9b040d4fd3"}
Oct 30 20:43:07.619228 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:07.619195    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:07.858692 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:07.858659    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:08.661094 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:08.661062    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:08.995908 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:08.995825    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:09.380625 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:09.380594    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-dkcgw" event={"ID":"26cc8cba-9eff-426b-b98a-c88816f103c7","Type":"ContainerStarted","Data":"a8c432d9a90955369ba6565fd6269097742ab6c235622d8453e782d642fab7ff"}
Oct 30 20:43:09.451771 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:09.451731    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-dkcgw" podStartSLOduration=1.201929994 podStartE2EDuration="3.451716777s" totalImagesPullingTime="2.249786783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:43:09.449875378 +0000 UTC m=+257.269387365" watchObservedRunningTime="2026-10-30 20:43:09.451716777 +0000 UTC m=+257.271228765"
Oct 30 20:43:13.143069 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:13.143032    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:13.358097 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:13.358061    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:14.319438 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:14.319402    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:14.528086 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:14.528050    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:20.272849 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:20.272809    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:23.713068 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:23.713017    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:23.928833 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:43:23.928797    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:43:26.658609 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:26.658569    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:26.867199 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:26.867163    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:27.992757 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:27.992725    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:28.212735 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:28.212702    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:32.475416 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:32.475375    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:32.725914 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:32.725832    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:32.983665 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:32.983582    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:39.579677 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:39.579643    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:39.779404 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:39.779345    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:42.809046 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:42.809010    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:48.157234 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:48.157180    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:48.384834 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:48.384803    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:49.586369 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:49.586335    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:52.316617 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:52.316578    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 20:43:52.319599 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:43:52.319577    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 20:43:53.927291 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:43:53.927248    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:44:04.363321 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.363236    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:44:04.429864 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.429836    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-p6rxs"]
Oct 30 20:44:04.433140 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.433124    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-p6rxs"
Oct 30 20:44:04.442291 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.442271    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-s9jr5\""
Oct 30 20:44:04.442291 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.442275    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Oct 30 20:44:04.448568 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.448546    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-p6rxs"]
Oct 30 20:44:04.468426 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.468405    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-8jvn6"]
Oct 30 20:44:04.471564 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.471545    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-8jvn6"
Oct 30 20:44:04.477005 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.476982    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4dvwz\""
Oct 30 20:44:04.477103 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.476991    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Oct 30 20:44:04.477103 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.477053    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Oct 30 20:44:04.497092 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.497069    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 20:44:04.497092 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.497086    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 20:44:04.497222 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.497125    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-8jvn6"]
Oct 30 20:44:04.544616 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.544588    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df574cad-90aa-412f-a80b-47ad82bae3d3-metrics-certs\") pod \"odh-model-controller-769875db56-8jvn6\" (UID: \"df574cad-90aa-412f-a80b-47ad82bae3d3\") " pod="opendatahub/odh-model-controller-769875db56-8jvn6"
Oct 30 20:44:04.544727 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.544655    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e87c7645-a0a3-4d64-b7d2-341ae1904c3f-tls-certs\") pod \"model-serving-api-75bd89fdfc-p6rxs\" (UID: \"e87c7645-a0a3-4d64-b7d2-341ae1904c3f\") " pod="opendatahub/model-serving-api-75bd89fdfc-p6rxs"
Oct 30 20:44:04.544803 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.544788    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df574cad-90aa-412f-a80b-47ad82bae3d3-cert\") pod \"odh-model-controller-769875db56-8jvn6\" (UID: \"df574cad-90aa-412f-a80b-47ad82bae3d3\") " pod="opendatahub/odh-model-controller-769875db56-8jvn6"
Oct 30 20:44:04.544852 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.544817    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fprt6\" (UniqueName: \"kubernetes.io/projected/df574cad-90aa-412f-a80b-47ad82bae3d3-kube-api-access-fprt6\") pod \"odh-model-controller-769875db56-8jvn6\" (UID: \"df574cad-90aa-412f-a80b-47ad82bae3d3\") " pod="opendatahub/odh-model-controller-769875db56-8jvn6"
Oct 30 20:44:04.544895 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.544847    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r25f\" (UniqueName: \"kubernetes.io/projected/e87c7645-a0a3-4d64-b7d2-341ae1904c3f-kube-api-access-9r25f\") pod \"model-serving-api-75bd89fdfc-p6rxs\" (UID: \"e87c7645-a0a3-4d64-b7d2-341ae1904c3f\") " pod="opendatahub/model-serving-api-75bd89fdfc-p6rxs"
Oct 30 20:44:04.613619 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.613548    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:44:04.645882 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.645855    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df574cad-90aa-412f-a80b-47ad82bae3d3-cert\") pod \"odh-model-controller-769875db56-8jvn6\" (UID: \"df574cad-90aa-412f-a80b-47ad82bae3d3\") " pod="opendatahub/odh-model-controller-769875db56-8jvn6"
Oct 30 20:44:04.646024 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.645898    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fprt6\" (UniqueName: \"kubernetes.io/projected/df574cad-90aa-412f-a80b-47ad82bae3d3-kube-api-access-fprt6\") pod \"odh-model-controller-769875db56-8jvn6\" (UID: \"df574cad-90aa-412f-a80b-47ad82bae3d3\") " pod="opendatahub/odh-model-controller-769875db56-8jvn6"
Oct 30 20:44:04.646024 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.645928    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r25f\" (UniqueName: \"kubernetes.io/projected/e87c7645-a0a3-4d64-b7d2-341ae1904c3f-kube-api-access-9r25f\") pod \"model-serving-api-75bd89fdfc-p6rxs\" (UID: \"e87c7645-a0a3-4d64-b7d2-341ae1904c3f\") " pod="opendatahub/model-serving-api-75bd89fdfc-p6rxs"
Oct 30 20:44:04.646024 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.645987    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df574cad-90aa-412f-a80b-47ad82bae3d3-metrics-certs\") pod \"odh-model-controller-769875db56-8jvn6\" (UID: \"df574cad-90aa-412f-a80b-47ad82bae3d3\") " pod="opendatahub/odh-model-controller-769875db56-8jvn6"
Oct 30 20:44:04.646458 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.646428    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e87c7645-a0a3-4d64-b7d2-341ae1904c3f-tls-certs\") pod \"model-serving-api-75bd89fdfc-p6rxs\" (UID: \"e87c7645-a0a3-4d64-b7d2-341ae1904c3f\") " pod="opendatahub/model-serving-api-75bd89fdfc-p6rxs"
Oct 30 20:44:04.648779 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.648748    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df574cad-90aa-412f-a80b-47ad82bae3d3-cert\") pod \"odh-model-controller-769875db56-8jvn6\" (UID: \"df574cad-90aa-412f-a80b-47ad82bae3d3\") " pod="opendatahub/odh-model-controller-769875db56-8jvn6"
Oct 30 20:44:04.648892 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.648866    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e87c7645-a0a3-4d64-b7d2-341ae1904c3f-tls-certs\") pod \"model-serving-api-75bd89fdfc-p6rxs\" (UID: \"e87c7645-a0a3-4d64-b7d2-341ae1904c3f\") " pod="opendatahub/model-serving-api-75bd89fdfc-p6rxs"
Oct 30 20:44:04.648892 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.648876    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df574cad-90aa-412f-a80b-47ad82bae3d3-metrics-certs\") pod \"odh-model-controller-769875db56-8jvn6\" (UID: \"df574cad-90aa-412f-a80b-47ad82bae3d3\") " pod="opendatahub/odh-model-controller-769875db56-8jvn6"
Oct 30 20:44:04.662693 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.662662    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r25f\" (UniqueName: \"kubernetes.io/projected/e87c7645-a0a3-4d64-b7d2-341ae1904c3f-kube-api-access-9r25f\") pod \"model-serving-api-75bd89fdfc-p6rxs\" (UID: \"e87c7645-a0a3-4d64-b7d2-341ae1904c3f\") " pod="opendatahub/model-serving-api-75bd89fdfc-p6rxs"
Oct 30 20:44:04.662883 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.662864    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fprt6\" (UniqueName: \"kubernetes.io/projected/df574cad-90aa-412f-a80b-47ad82bae3d3-kube-api-access-fprt6\") pod \"odh-model-controller-769875db56-8jvn6\" (UID: \"df574cad-90aa-412f-a80b-47ad82bae3d3\") " pod="opendatahub/odh-model-controller-769875db56-8jvn6"
Oct 30 20:44:04.746084 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.746062    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-p6rxs"
Oct 30 20:44:04.758796 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.758771    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"]
Oct 30 20:44:04.762203 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.762187    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.781896 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.781876    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"]
Oct 30 20:44:04.783313 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.783292    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-8jvn6"
Oct 30 20:44:04.843328 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.843299    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:44:04.851291 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.851111    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f858690f-051c-4fa3-b4d7-bad7392d5650-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.851291 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.851174    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f858690f-051c-4fa3-b4d7-bad7392d5650-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.851291 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.851235    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f858690f-051c-4fa3-b4d7-bad7392d5650-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.851291 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.851267    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29gm8\" (UniqueName: \"kubernetes.io/projected/f858690f-051c-4fa3-b4d7-bad7392d5650-kube-api-access-29gm8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.851565 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.851317    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f858690f-051c-4fa3-b4d7-bad7392d5650-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.851565 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.851341    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f858690f-051c-4fa3-b4d7-bad7392d5650-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.851565 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.851385    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f858690f-051c-4fa3-b4d7-bad7392d5650-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.952103 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.952049    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f858690f-051c-4fa3-b4d7-bad7392d5650-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.952103 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.952089    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f858690f-051c-4fa3-b4d7-bad7392d5650-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.952262 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.952107    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29gm8\" (UniqueName: \"kubernetes.io/projected/f858690f-051c-4fa3-b4d7-bad7392d5650-kube-api-access-29gm8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.952320 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.952275    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f858690f-051c-4fa3-b4d7-bad7392d5650-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.952320 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.952303    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f858690f-051c-4fa3-b4d7-bad7392d5650-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.952469 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.952322    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f858690f-051c-4fa3-b4d7-bad7392d5650-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.952550 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.952507    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f858690f-051c-4fa3-b4d7-bad7392d5650-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.953082 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.953050    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f858690f-051c-4fa3-b4d7-bad7392d5650-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.954322 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.954302    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f858690f-051c-4fa3-b4d7-bad7392d5650-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.959816 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.954672    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f858690f-051c-4fa3-b4d7-bad7392d5650-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.960418 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.960398    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f858690f-051c-4fa3-b4d7-bad7392d5650-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.960527 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.960429    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f858690f-051c-4fa3-b4d7-bad7392d5650-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.969051 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.969031    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29gm8\" (UniqueName: \"kubernetes.io/projected/f858690f-051c-4fa3-b4d7-bad7392d5650-kube-api-access-29gm8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:04.969140 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:04.969124    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f858690f-051c-4fa3-b4d7-bad7392d5650-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-p9tv7\" (UID: \"f858690f-051c-4fa3-b4d7-bad7392d5650\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:05.044723 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:05.044698    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-p6rxs"]
Oct 30 20:44:05.046117 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:44:05.046094    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode87c7645_a0a3_4d64_b7d2_341ae1904c3f.slice/crio-2c4eb95092ff14b996ad3061953fe51a4fb7e29e8ba9b67fd43763313b427cd6 WatchSource:0}: Error finding container 2c4eb95092ff14b996ad3061953fe51a4fb7e29e8ba9b67fd43763313b427cd6: Status 404 returned error can't find the container with id 2c4eb95092ff14b996ad3061953fe51a4fb7e29e8ba9b67fd43763313b427cd6
Oct 30 20:44:05.048206 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:05.048189    4948 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:44:05.069379 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:05.069336    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-8jvn6"]
Oct 30 20:44:05.071338 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:44:05.071314    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf574cad_90aa_412f_a80b_47ad82bae3d3.slice/crio-97f3fb0357f3a24f43733b339844b0f76fe2c8507c9640af7abea98f6e2deac1 WatchSource:0}: Error finding container 97f3fb0357f3a24f43733b339844b0f76fe2c8507c9640af7abea98f6e2deac1: Status 404 returned error can't find the container with id 97f3fb0357f3a24f43733b339844b0f76fe2c8507c9640af7abea98f6e2deac1
Oct 30 20:44:05.076002 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:05.075985    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:05.363297 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:05.363273    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"]
Oct 30 20:44:05.366069 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:44:05.366045    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf858690f_051c_4fa3_b4d7_bad7392d5650.slice/crio-fd3b9745c70b2d6214b067d91baf8cae948a9909b9a283dc1c36434519355cd9 WatchSource:0}: Error finding container fd3b9745c70b2d6214b067d91baf8cae948a9909b9a283dc1c36434519355cd9: Status 404 returned error can't find the container with id fd3b9745c70b2d6214b067d91baf8cae948a9909b9a283dc1c36434519355cd9
Oct 30 20:44:05.368055 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:05.368027    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:44:05.368139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:05.368078    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:44:05.614270 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:05.614196    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-p6rxs" event={"ID":"e87c7645-a0a3-4d64-b7d2-341ae1904c3f","Type":"ContainerStarted","Data":"2c4eb95092ff14b996ad3061953fe51a4fb7e29e8ba9b67fd43763313b427cd6"}
Oct 30 20:44:05.615762 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:05.615735    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7" event={"ID":"f858690f-051c-4fa3-b4d7-bad7392d5650","Type":"ContainerStarted","Data":"18ac5084b6aeeaeb6544da8f28d9b1a774477fa02ecdc965468d3f22323af11f"}
Oct 30 20:44:05.615890 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:05.615778    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7" event={"ID":"f858690f-051c-4fa3-b4d7-bad7392d5650","Type":"ContainerStarted","Data":"fd3b9745c70b2d6214b067d91baf8cae948a9909b9a283dc1c36434519355cd9"}
Oct 30 20:44:05.615890 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:05.615839    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:05.616943 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:05.616915    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-8jvn6" event={"ID":"df574cad-90aa-412f-a80b-47ad82bae3d3","Type":"ContainerStarted","Data":"97f3fb0357f3a24f43733b339844b0f76fe2c8507c9640af7abea98f6e2deac1"}
Oct 30 20:44:05.647172 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:05.647103    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7" podStartSLOduration=1.647086525 podStartE2EDuration="1.647086525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:05.645230337 +0000 UTC m=+313.464742326" watchObservedRunningTime="2026-10-30 20:44:05.647086525 +0000 UTC m=+313.466598536"
Oct 30 20:44:06.128783 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:06.128738    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:44:06.363187 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:06.363082    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:44:06.625022 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:06.624998    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-p9tv7"
Oct 30 20:44:06.685334 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:06.685304    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"]
Oct 30 20:44:06.685570 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:06.685533    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh" podUID="c1274c3f-3f8c-45b9-91e6-b81344a1b0bc" containerName="discovery" containerID="cri-o://43ae10bde7628d236b16f0b91a382faad3949d81ce1f566c0a80e8ee931653d2" gracePeriod=30
Oct 30 20:44:06.969139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:06.969111    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:44:07.072819 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.072792    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-csr-ca-configmap\") pod \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") "
Oct 30 20:44:07.072997 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.072832    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-kubeconfig\") pod \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") "
Oct 30 20:44:07.072997 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.072892    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-local-certs\") pod \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") "
Oct 30 20:44:07.072997 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.072956    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-token\" (UniqueName: \"kubernetes.io/projected/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-token\") pod \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") "
Oct 30 20:44:07.072997 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.072993    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-csr-dns-cert\") pod \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") "
Oct 30 20:44:07.073210 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.073041    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-cacerts\" (UniqueName: \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-cacerts\") pod \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") "
Oct 30 20:44:07.073210 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.073091    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-kube-api-access-5gcgv\" (UniqueName: \"kubernetes.io/projected/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-kube-api-access-5gcgv\") pod \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\" (UID: \"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc\") "
Oct 30 20:44:07.079260 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.079190    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-csr-dns-cert" pod "c1274c3f-3f8c-45b9-91e6-b81344a1b0bc" (UID: "c1274c3f-3f8c-45b9-91e6-b81344a1b0bc"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:44:07.079676 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.079654    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-csr-ca-configmap" pod "c1274c3f-3f8c-45b9-91e6-b81344a1b0bc" (UID: "c1274c3f-3f8c-45b9-91e6-b81344a1b0bc"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:44:07.080699 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.080673    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-local-certs" pod "c1274c3f-3f8c-45b9-91e6-b81344a1b0bc" (UID: "c1274c3f-3f8c-45b9-91e6-b81344a1b0bc"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:44:07.080964 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.080936    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-kubeconfig" pod "c1274c3f-3f8c-45b9-91e6-b81344a1b0bc" (UID: "c1274c3f-3f8c-45b9-91e6-b81344a1b0bc"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:44:07.081102 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.081039    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-cacerts" pod "c1274c3f-3f8c-45b9-91e6-b81344a1b0bc" (UID: "c1274c3f-3f8c-45b9-91e6-b81344a1b0bc"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:44:07.081628 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.081609    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-token" pod "c1274c3f-3f8c-45b9-91e6-b81344a1b0bc" (UID: "c1274c3f-3f8c-45b9-91e6-b81344a1b0bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:44:07.082337 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.082320    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-kube-api-access-5gcgv" pod "c1274c3f-3f8c-45b9-91e6-b81344a1b0bc" (UID: "c1274c3f-3f8c-45b9-91e6-b81344a1b0bc"). InnerVolumeSpecName "kube-api-access-5gcgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:44:07.174094 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.173966    4948 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-local-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:07.174094 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.174004    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:07.174094 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.174021    4948 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-csr-dns-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:07.174094 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.174032    4948 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-cacerts\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:07.174094 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.174042    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gcgv\" (UniqueName: \"kubernetes.io/projected/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-kube-api-access-5gcgv\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:07.174094 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.174051    4948 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-csr-ca-configmap\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:07.174094 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.174059    4948 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc-istio-kubeconfig\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:44:07.628291 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.628256    4948 generic.go:356] "Generic (PLEG): container finished" podID="c1274c3f-3f8c-45b9-91e6-b81344a1b0bc" containerID="43ae10bde7628d236b16f0b91a382faad3949d81ce1f566c0a80e8ee931653d2" exitCode=0
Oct 30 20:44:07.628770 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.628306    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"
Oct 30 20:44:07.628770 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.628344    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh" event={"ID":"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc","Type":"ContainerDied","Data":"43ae10bde7628d236b16f0b91a382faad3949d81ce1f566c0a80e8ee931653d2"}
Oct 30 20:44:07.628770 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.628410    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh" event={"ID":"c1274c3f-3f8c-45b9-91e6-b81344a1b0bc","Type":"ContainerDied","Data":"e005c181c06ada07010680d8ac15780d01bd5ebf11932b28698821cfec0a5a31"}
Oct 30 20:44:07.628770 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.628439    4948 scope.go:122] "RemoveContainer" containerID="43ae10bde7628d236b16f0b91a382faad3949d81ce1f566c0a80e8ee931653d2"
Oct 30 20:44:07.630129 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.630105    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-p6rxs" event={"ID":"e87c7645-a0a3-4d64-b7d2-341ae1904c3f","Type":"ContainerStarted","Data":"f43bcd0cb81ae31815de1c60439ab5dcbc5819f3975b6e324d50dfed384549ed"}
Oct 30 20:44:07.638354 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.638338    4948 scope.go:122] "RemoveContainer" containerID="43ae10bde7628d236b16f0b91a382faad3949d81ce1f566c0a80e8ee931653d2"
Oct 30 20:44:07.638685 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:44:07.638661    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43ae10bde7628d236b16f0b91a382faad3949d81ce1f566c0a80e8ee931653d2\": container with ID starting with 43ae10bde7628d236b16f0b91a382faad3949d81ce1f566c0a80e8ee931653d2 not found: ID does not exist" containerID="43ae10bde7628d236b16f0b91a382faad3949d81ce1f566c0a80e8ee931653d2"
Oct 30 20:44:07.638780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.638689    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43ae10bde7628d236b16f0b91a382faad3949d81ce1f566c0a80e8ee931653d2"} err="failed to get container status \"43ae10bde7628d236b16f0b91a382faad3949d81ce1f566c0a80e8ee931653d2\": rpc error: code = NotFound desc = could not find container \"43ae10bde7628d236b16f0b91a382faad3949d81ce1f566c0a80e8ee931653d2\": container with ID starting with 43ae10bde7628d236b16f0b91a382faad3949d81ce1f566c0a80e8ee931653d2 not found: ID does not exist"
Oct 30 20:44:07.653857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.653813    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-p6rxs" podStartSLOduration=1.4349081240000001 podStartE2EDuration="3.653799306s" totalImagesPullingTime="2.218891182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:07.653592853 +0000 UTC m=+315.473104842" watchObservedRunningTime="2026-10-30 20:44:07.653799306 +0000 UTC m=+315.473311294"
Oct 30 20:44:07.667681 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.667655    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"]
Oct 30 20:44:07.671852 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:07.671834    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-q7qmh"]
Oct 30 20:44:08.295890 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:08.295806    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c1274c3f-3f8c-45b9-91e6-b81344a1b0bc" path="/var/lib/kubelet/pods/c1274c3f-3f8c-45b9-91e6-b81344a1b0bc/volumes"
Oct 30 20:44:08.635087 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:08.635050    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-8jvn6" event={"ID":"df574cad-90aa-412f-a80b-47ad82bae3d3","Type":"ContainerStarted","Data":"27d50baf188f0b373694a7edd040f2730b94c838a482bb6d35c980d7a5d34ec8"}
Oct 30 20:44:08.635530 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:08.635202    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-8jvn6"
Oct 30 20:44:08.636220 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:08.636203    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-p6rxs"
Oct 30 20:44:08.655710 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:08.655665    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-8jvn6" podStartSLOduration=1.687243942 podStartE2EDuration="4.655652093s" totalImagesPullingTime="2.968408151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:08.655631996 +0000 UTC m=+316.475143981" watchObservedRunningTime="2026-10-30 20:44:08.655652093 +0000 UTC m=+316.475164076"
Oct 30 20:44:13.481205 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:13.481163    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:44:13.688589 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:13.688552    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:44:19.642216 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:19.642187    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-8jvn6"
Oct 30 20:44:19.644249 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:19.644228    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-p6rxs"
Oct 30 20:44:20.832884 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:20.832849    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:44:21.033158 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:21.033128    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:44:23.925050 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:44:23.925016    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:44:32.772544 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:32.772503    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:44:32.973725 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:32.973680    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:44:36.746882 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:36.746847    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:44:42.879716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:44:42.879679    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:44:53.925949 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:44:53.925907    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:45:04.319342 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:45:04.319311    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:45:04.527593 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:45:04.527557    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:45:23.925384 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:45:23.925331    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:45:42.922585 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:45:42.922495    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:45:53.929503 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:45:53.929459    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:46:23.926297 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:46:23.926256    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:46:25.195732 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:46:25.195696    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:46:25.404682 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:46:25.404653    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:46:42.978805 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:46:42.978768    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:46:53.926481 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:46:53.926446    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:47:14.526774 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:47:14.526680    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:47:14.730746 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:47:14.730711    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:47:23.926230 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:47:23.926198    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:47:43.076937 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:47:43.076904    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:47:53.925673 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:47:53.925636    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:48:06.211687 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:48:06.211637    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:48:06.418833 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:48:06.418794    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:48:23.927039 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:48:23.927004    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:48:43.080973 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:48:43.080894    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:48:52.344141 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:48:52.344114    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 20:48:52.344688 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:48:52.344234    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 20:48:53.928505 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:48:53.928456    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:49:03.144252 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:49:03.144208    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:49:23.924736 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:49:23.924697    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:49:43.143254 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:49:43.143221    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:49:53.925316 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:49:53.925281    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:50:23.924876 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:50:23.924841    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:50:30.884117 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:50:30.884076    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:50:43.187845 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:50:43.187802    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:50:43.385570 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:50:43.385540    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:50:53.925025 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:50:53.924985    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:51:23.925850 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:51:23.925816    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:51:43.238737 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:51:43.238655    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:51:53.925129 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:51:53.925093    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:52:23.928175 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:52:23.928136    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:52:43.296757 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:52:43.296715    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:52:53.927830 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:52:53.927789    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:53:23.929143 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:53:23.929018    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:53:43.364816 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:43.364777    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:53:43.842413 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:43.842346    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-9jccz"]
Oct 30 20:53:43.842763 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:43.842745    4948 cpu_manager.go:414] "containerMap: removing container" podUID="c1274c3f-3f8c-45b9-91e6-b81344a1b0bc" containerName="discovery"
Oct 30 20:53:43.842811 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:43.842766    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1274c3f-3f8c-45b9-91e6-b81344a1b0bc" containerName="discovery"
Oct 30 20:53:43.842865 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:43.842855    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="c1274c3f-3f8c-45b9-91e6-b81344a1b0bc" containerName="discovery"
Oct 30 20:53:43.845763 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:43.845722    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz"
Oct 30 20:53:43.854129 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:43.854105    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 30 20:53:43.855440 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:43.855417    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 20:53:43.855561 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:43.855442    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 20:53:43.855624 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:43.855600    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qj27b\""
Oct 30 20:53:43.865084 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:43.865040    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-9jccz"]
Oct 30 20:53:43.946281 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:43.946243    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-9jccz"]
Oct 30 20:53:43.998153 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:43.998116    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:53:44.031261 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:44.031219    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j7jf\" (UniqueName: \"kubernetes.io/projected/ccbf80fe-141c-4aea-93eb-10d1869841b8-kube-api-access-2j7jf\") pod \"limitador-limitador-74dfcfb894-9jccz\" (UID: \"ccbf80fe-141c-4aea-93eb-10d1869841b8\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz"
Oct 30 20:53:44.031432 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:44.031384    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ccbf80fe-141c-4aea-93eb-10d1869841b8-config-file\") pod \"limitador-limitador-74dfcfb894-9jccz\" (UID: \"ccbf80fe-141c-4aea-93eb-10d1869841b8\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz"
Oct 30 20:53:44.132277 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:44.132150    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ccbf80fe-141c-4aea-93eb-10d1869841b8-config-file\") pod \"limitador-limitador-74dfcfb894-9jccz\" (UID: \"ccbf80fe-141c-4aea-93eb-10d1869841b8\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz"
Oct 30 20:53:44.132277 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:44.132231    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j7jf\" (UniqueName: \"kubernetes.io/projected/ccbf80fe-141c-4aea-93eb-10d1869841b8-kube-api-access-2j7jf\") pod \"limitador-limitador-74dfcfb894-9jccz\" (UID: \"ccbf80fe-141c-4aea-93eb-10d1869841b8\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz"
Oct 30 20:53:44.132890 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:44.132868    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ccbf80fe-141c-4aea-93eb-10d1869841b8-config-file\") pod \"limitador-limitador-74dfcfb894-9jccz\" (UID: \"ccbf80fe-141c-4aea-93eb-10d1869841b8\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz"
Oct 30 20:53:44.146522 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:44.146493    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j7jf\" (UniqueName: \"kubernetes.io/projected/ccbf80fe-141c-4aea-93eb-10d1869841b8-kube-api-access-2j7jf\") pod \"limitador-limitador-74dfcfb894-9jccz\" (UID: \"ccbf80fe-141c-4aea-93eb-10d1869841b8\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz"
Oct 30 20:53:44.161350 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:44.161311    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz"
Oct 30 20:53:44.283496 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:44.283459    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:53:44.447372 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:44.447334    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-9jccz"]
Oct 30 20:53:44.450332 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:53:44.450300    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbf80fe_141c_4aea_93eb_10d1869841b8.slice/crio-75774f76d500f912d6367ee4b0cd6a13c217850331701b19c3422f7490ac7b1a WatchSource:0}: Error finding container 75774f76d500f912d6367ee4b0cd6a13c217850331701b19c3422f7490ac7b1a: Status 404 returned error can't find the container with id 75774f76d500f912d6367ee4b0cd6a13c217850331701b19c3422f7490ac7b1a
Oct 30 20:53:44.452386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:44.452353    4948 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:53:44.813089 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:44.813001    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-bm7lk"]
Oct 30 20:53:44.817625 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:44.817597    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-bm7lk"
Oct 30 20:53:44.836650 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:44.836607    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jp6gl\""
Oct 30 20:53:44.836843 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:44.836775    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-bm7lk"]
Oct 30 20:53:44.926027 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:44.925989    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz" event={"ID":"ccbf80fe-141c-4aea-93eb-10d1869841b8","Type":"ContainerStarted","Data":"75774f76d500f912d6367ee4b0cd6a13c217850331701b19c3422f7490ac7b1a"}
Oct 30 20:53:44.938423 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:44.938356    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxmhx\" (UniqueName: \"kubernetes.io/projected/ee51d08d-457c-4eb8-bec1-52dd345a9878-kube-api-access-rxmhx\") pod \"authorino-57f7f8659f-bm7lk\" (UID: \"ee51d08d-457c-4eb8-bec1-52dd345a9878\") " pod="kuadrant-system/authorino-57f7f8659f-bm7lk"
Oct 30 20:53:45.031968 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:45.031928    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:53:45.039017 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:45.038986    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxmhx\" (UniqueName: \"kubernetes.io/projected/ee51d08d-457c-4eb8-bec1-52dd345a9878-kube-api-access-rxmhx\") pod \"authorino-57f7f8659f-bm7lk\" (UID: \"ee51d08d-457c-4eb8-bec1-52dd345a9878\") " pod="kuadrant-system/authorino-57f7f8659f-bm7lk"
Oct 30 20:53:45.060281 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:45.060240    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxmhx\" (UniqueName: \"kubernetes.io/projected/ee51d08d-457c-4eb8-bec1-52dd345a9878-kube-api-access-rxmhx\") pod \"authorino-57f7f8659f-bm7lk\" (UID: \"ee51d08d-457c-4eb8-bec1-52dd345a9878\") " pod="kuadrant-system/authorino-57f7f8659f-bm7lk"
Oct 30 20:53:45.146504 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:45.146458    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-bm7lk"
Oct 30 20:53:45.325819 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:45.325783    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:53:45.429945 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:45.429853    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-bm7lk"]
Oct 30 20:53:45.933168 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:45.933123    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-bm7lk" event={"ID":"ee51d08d-457c-4eb8-bec1-52dd345a9878","Type":"ContainerStarted","Data":"c96937c959c6f375fe40276ace5bf5891b99df9c0854d74ac16c4b4626427b9e"}
Oct 30 20:53:47.956602 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:47.956556    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz" event={"ID":"ccbf80fe-141c-4aea-93eb-10d1869841b8","Type":"ContainerStarted","Data":"560f05111aa956149aa60ef27488b31be40238166a48b2817bef7704899a6767"}
Oct 30 20:53:47.957134 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:47.956751    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz"
Oct 30 20:53:47.958263 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:47.958227    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-bm7lk" event={"ID":"ee51d08d-457c-4eb8-bec1-52dd345a9878","Type":"ContainerStarted","Data":"ecbb4a47c571c2abbe7537ffe2025f4ae481a3cb5a1aedf1e7f1a40bd8997fbd"}
Oct 30 20:53:47.976470 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:47.976396    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz" podStartSLOduration=2.270362401 podStartE2EDuration="4.97638093s" totalImagesPullingTime="2.706018529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:47.975297413 +0000 UTC m=+895.794809402" watchObservedRunningTime="2026-10-30 20:53:47.97638093 +0000 UTC m=+895.795892912"
Oct 30 20:53:47.993121 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:47.993057    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-bm7lk" podStartSLOduration=1.6370551679999998 podStartE2EDuration="3.993039252s" totalImagesPullingTime="2.355984084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:47.991773201 +0000 UTC m=+895.811285188" watchObservedRunningTime="2026-10-30 20:53:47.993039252 +0000 UTC m=+895.812551240"
Oct 30 20:53:49.005012 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:49.004964    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-bm7lk"]
Oct 30 20:53:49.968104 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:49.968061    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-bm7lk" podUID="ee51d08d-457c-4eb8-bec1-52dd345a9878" containerName="authorino" containerID="cri-o://ecbb4a47c571c2abbe7537ffe2025f4ae481a3cb5a1aedf1e7f1a40bd8997fbd" gracePeriod=30
Oct 30 20:53:50.231614 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:50.231532    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-bm7lk"
Oct 30 20:53:50.280943 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:50.280906    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee51d08d-457c-4eb8-bec1-52dd345a9878-kube-api-access-rxmhx\" (UniqueName: \"kubernetes.io/projected/ee51d08d-457c-4eb8-bec1-52dd345a9878-kube-api-access-rxmhx\") pod \"ee51d08d-457c-4eb8-bec1-52dd345a9878\" (UID: \"ee51d08d-457c-4eb8-bec1-52dd345a9878\") "
Oct 30 20:53:50.283326 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:50.283295    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee51d08d-457c-4eb8-bec1-52dd345a9878-kube-api-access-rxmhx" pod "ee51d08d-457c-4eb8-bec1-52dd345a9878" (UID: "ee51d08d-457c-4eb8-bec1-52dd345a9878"). InnerVolumeSpecName "kube-api-access-rxmhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:50.381715 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:50.381670    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxmhx\" (UniqueName: \"kubernetes.io/projected/ee51d08d-457c-4eb8-bec1-52dd345a9878-kube-api-access-rxmhx\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:53:50.973761 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:50.973721    4948 generic.go:356] "Generic (PLEG): container finished" podID="ee51d08d-457c-4eb8-bec1-52dd345a9878" containerID="ecbb4a47c571c2abbe7537ffe2025f4ae481a3cb5a1aedf1e7f1a40bd8997fbd" exitCode=0
Oct 30 20:53:50.973987 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:50.973772    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-bm7lk"
Oct 30 20:53:50.973987 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:50.973791    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-bm7lk" event={"ID":"ee51d08d-457c-4eb8-bec1-52dd345a9878","Type":"ContainerDied","Data":"ecbb4a47c571c2abbe7537ffe2025f4ae481a3cb5a1aedf1e7f1a40bd8997fbd"}
Oct 30 20:53:50.973987 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:50.973832    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-bm7lk" event={"ID":"ee51d08d-457c-4eb8-bec1-52dd345a9878","Type":"ContainerDied","Data":"c96937c959c6f375fe40276ace5bf5891b99df9c0854d74ac16c4b4626427b9e"}
Oct 30 20:53:50.973987 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:50.973856    4948 scope.go:122] "RemoveContainer" containerID="ecbb4a47c571c2abbe7537ffe2025f4ae481a3cb5a1aedf1e7f1a40bd8997fbd"
Oct 30 20:53:50.984107 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:50.984084    4948 scope.go:122] "RemoveContainer" containerID="ecbb4a47c571c2abbe7537ffe2025f4ae481a3cb5a1aedf1e7f1a40bd8997fbd"
Oct 30 20:53:50.984658 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:53:50.984632    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecbb4a47c571c2abbe7537ffe2025f4ae481a3cb5a1aedf1e7f1a40bd8997fbd\": container with ID starting with ecbb4a47c571c2abbe7537ffe2025f4ae481a3cb5a1aedf1e7f1a40bd8997fbd not found: ID does not exist" containerID="ecbb4a47c571c2abbe7537ffe2025f4ae481a3cb5a1aedf1e7f1a40bd8997fbd"
Oct 30 20:53:50.984764 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:50.984666    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecbb4a47c571c2abbe7537ffe2025f4ae481a3cb5a1aedf1e7f1a40bd8997fbd"} err="failed to get container status \"ecbb4a47c571c2abbe7537ffe2025f4ae481a3cb5a1aedf1e7f1a40bd8997fbd\": rpc error: code = NotFound desc = could not find container \"ecbb4a47c571c2abbe7537ffe2025f4ae481a3cb5a1aedf1e7f1a40bd8997fbd\": container with ID starting with ecbb4a47c571c2abbe7537ffe2025f4ae481a3cb5a1aedf1e7f1a40bd8997fbd not found: ID does not exist"
Oct 30 20:53:50.995201 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:50.995163    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-bm7lk"]
Oct 30 20:53:51.000039 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:51.000005    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-bm7lk"]
Oct 30 20:53:52.292416 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:52.292384    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ee51d08d-457c-4eb8-bec1-52dd345a9878" path="/var/lib/kubelet/pods/ee51d08d-457c-4eb8-bec1-52dd345a9878/volumes"
Oct 30 20:53:52.383679 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:52.383651    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 20:53:52.385560 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:52.385533    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 20:53:53.928611 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:53:53.928572    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:53:58.366116 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:58.366076    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-9jccz"]
Oct 30 20:53:58.366653 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:58.366382    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz" podUID="ccbf80fe-141c-4aea-93eb-10d1869841b8" containerName="limitador" containerID="cri-o://560f05111aa956149aa60ef27488b31be40238166a48b2817bef7704899a6767" gracePeriod=30
Oct 30 20:53:58.367104 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:58.366965    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz"
Oct 30 20:53:58.920964 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:58.920933    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz"
Oct 30 20:53:58.942781 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:58.942684    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ccbf80fe-141c-4aea-93eb-10d1869841b8-config-file\" (UniqueName: \"kubernetes.io/configmap/ccbf80fe-141c-4aea-93eb-10d1869841b8-config-file\") pod \"ccbf80fe-141c-4aea-93eb-10d1869841b8\" (UID: \"ccbf80fe-141c-4aea-93eb-10d1869841b8\") "
Oct 30 20:53:58.943093 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:58.943064    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccbf80fe-141c-4aea-93eb-10d1869841b8-config-file" pod "ccbf80fe-141c-4aea-93eb-10d1869841b8" (UID: "ccbf80fe-141c-4aea-93eb-10d1869841b8"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:53:59.012295 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:59.012258    4948 generic.go:356] "Generic (PLEG): container finished" podID="ccbf80fe-141c-4aea-93eb-10d1869841b8" containerID="560f05111aa956149aa60ef27488b31be40238166a48b2817bef7704899a6767" exitCode=0
Oct 30 20:53:59.012525 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:59.012310    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz"
Oct 30 20:53:59.012525 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:59.012325    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz" event={"ID":"ccbf80fe-141c-4aea-93eb-10d1869841b8","Type":"ContainerDied","Data":"560f05111aa956149aa60ef27488b31be40238166a48b2817bef7704899a6767"}
Oct 30 20:53:59.012525 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:59.012402    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-9jccz" event={"ID":"ccbf80fe-141c-4aea-93eb-10d1869841b8","Type":"ContainerDied","Data":"75774f76d500f912d6367ee4b0cd6a13c217850331701b19c3422f7490ac7b1a"}
Oct 30 20:53:59.012525 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:59.012425    4948 scope.go:122] "RemoveContainer" containerID="560f05111aa956149aa60ef27488b31be40238166a48b2817bef7704899a6767"
Oct 30 20:53:59.020946 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:59.020922    4948 scope.go:122] "RemoveContainer" containerID="560f05111aa956149aa60ef27488b31be40238166a48b2817bef7704899a6767"
Oct 30 20:53:59.021302 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:53:59.021281    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"560f05111aa956149aa60ef27488b31be40238166a48b2817bef7704899a6767\": container with ID starting with 560f05111aa956149aa60ef27488b31be40238166a48b2817bef7704899a6767 not found: ID does not exist" containerID="560f05111aa956149aa60ef27488b31be40238166a48b2817bef7704899a6767"
Oct 30 20:53:59.021374 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:59.021314    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"560f05111aa956149aa60ef27488b31be40238166a48b2817bef7704899a6767"} err="failed to get container status \"560f05111aa956149aa60ef27488b31be40238166a48b2817bef7704899a6767\": rpc error: code = NotFound desc = could not find container \"560f05111aa956149aa60ef27488b31be40238166a48b2817bef7704899a6767\": container with ID starting with 560f05111aa956149aa60ef27488b31be40238166a48b2817bef7704899a6767 not found: ID does not exist"
Oct 30 20:53:59.043645 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:59.043612    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ccbf80fe-141c-4aea-93eb-10d1869841b8-kube-api-access-2j7jf\" (UniqueName: \"kubernetes.io/projected/ccbf80fe-141c-4aea-93eb-10d1869841b8-kube-api-access-2j7jf\") pod \"ccbf80fe-141c-4aea-93eb-10d1869841b8\" (UID: \"ccbf80fe-141c-4aea-93eb-10d1869841b8\") "
Oct 30 20:53:59.043807 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:59.043794    4948 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ccbf80fe-141c-4aea-93eb-10d1869841b8-config-file\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:53:59.045853 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:59.045822    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccbf80fe-141c-4aea-93eb-10d1869841b8-kube-api-access-2j7jf" pod "ccbf80fe-141c-4aea-93eb-10d1869841b8" (UID: "ccbf80fe-141c-4aea-93eb-10d1869841b8"). InnerVolumeSpecName "kube-api-access-2j7jf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:59.144660 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:59.144619    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j7jf\" (UniqueName: \"kubernetes.io/projected/ccbf80fe-141c-4aea-93eb-10d1869841b8-kube-api-access-2j7jf\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:53:59.357874 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:59.357830    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-9jccz"]
Oct 30 20:53:59.366242 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:53:59.366205    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-9jccz"]
Oct 30 20:54:00.292079 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:00.292031    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ccbf80fe-141c-4aea-93eb-10d1869841b8" path="/var/lib/kubelet/pods/ccbf80fe-141c-4aea-93eb-10d1869841b8/volumes"
Oct 30 20:54:01.177198 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.177145    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:54:01.780090 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.780056    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-c8m2j"]
Oct 30 20:54:01.780423 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.780409    4948 cpu_manager.go:414] "containerMap: removing container" podUID="ccbf80fe-141c-4aea-93eb-10d1869841b8" containerName="limitador"
Oct 30 20:54:01.780480 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.780424    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ccbf80fe-141c-4aea-93eb-10d1869841b8" containerName="limitador"
Oct 30 20:54:01.780480 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.780456    4948 cpu_manager.go:414] "containerMap: removing container" podUID="ee51d08d-457c-4eb8-bec1-52dd345a9878" containerName="authorino"
Oct 30 20:54:01.780480 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.780461    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee51d08d-457c-4eb8-bec1-52dd345a9878" containerName="authorino"
Oct 30 20:54:01.780587 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.780532    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="ccbf80fe-141c-4aea-93eb-10d1869841b8" containerName="limitador"
Oct 30 20:54:01.780587 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.780545    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee51d08d-457c-4eb8-bec1-52dd345a9878" containerName="authorino"
Oct 30 20:54:01.784999 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.784973    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-c8m2j"
Oct 30 20:54:01.794342 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.794313    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-c8m2j"]
Oct 30 20:54:01.800162 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.800135    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Oct 30 20:54:01.800162 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.800136    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-699jz\""
Oct 30 20:54:01.801660 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.801637    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 20:54:01.801660 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.801651    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 20:54:01.865697 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.865659    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1a22a4ff-734b-412c-bbe2-57b87c6222f4-data\") pod \"postgres-7cdbf6dc44-c8m2j\" (UID: \"1a22a4ff-734b-412c-bbe2-57b87c6222f4\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-c8m2j"
Oct 30 20:54:01.865897 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.865773    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzjft\" (UniqueName: \"kubernetes.io/projected/1a22a4ff-734b-412c-bbe2-57b87c6222f4-kube-api-access-nzjft\") pod \"postgres-7cdbf6dc44-c8m2j\" (UID: \"1a22a4ff-734b-412c-bbe2-57b87c6222f4\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-c8m2j"
Oct 30 20:54:01.966260 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.966217    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzjft\" (UniqueName: \"kubernetes.io/projected/1a22a4ff-734b-412c-bbe2-57b87c6222f4-kube-api-access-nzjft\") pod \"postgres-7cdbf6dc44-c8m2j\" (UID: \"1a22a4ff-734b-412c-bbe2-57b87c6222f4\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-c8m2j"
Oct 30 20:54:01.966507 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.966278    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1a22a4ff-734b-412c-bbe2-57b87c6222f4-data\") pod \"postgres-7cdbf6dc44-c8m2j\" (UID: \"1a22a4ff-734b-412c-bbe2-57b87c6222f4\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-c8m2j"
Oct 30 20:54:01.966741 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.966724    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1a22a4ff-734b-412c-bbe2-57b87c6222f4-data\") pod \"postgres-7cdbf6dc44-c8m2j\" (UID: \"1a22a4ff-734b-412c-bbe2-57b87c6222f4\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-c8m2j"
Oct 30 20:54:01.980577 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:01.980538    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzjft\" (UniqueName: \"kubernetes.io/projected/1a22a4ff-734b-412c-bbe2-57b87c6222f4-kube-api-access-nzjft\") pod \"postgres-7cdbf6dc44-c8m2j\" (UID: \"1a22a4ff-734b-412c-bbe2-57b87c6222f4\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-c8m2j"
Oct 30 20:54:02.101030 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:02.100989    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-c8m2j"
Oct 30 20:54:02.394908 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:02.394866    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-c8m2j"]
Oct 30 20:54:02.397789 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:54:02.397757    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a22a4ff_734b_412c_bbe2_57b87c6222f4.slice/crio-677fb1f325c145a1f80b46430b5eceedb4dac75a2d4f60d4a0a1f3fd6a708a5e WatchSource:0}: Error finding container 677fb1f325c145a1f80b46430b5eceedb4dac75a2d4f60d4a0a1f3fd6a708a5e: Status 404 returned error can't find the container with id 677fb1f325c145a1f80b46430b5eceedb4dac75a2d4f60d4a0a1f3fd6a708a5e
Oct 30 20:54:03.030691 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:03.030653    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-c8m2j" event={"ID":"1a22a4ff-734b-412c-bbe2-57b87c6222f4","Type":"ContainerStarted","Data":"677fb1f325c145a1f80b46430b5eceedb4dac75a2d4f60d4a0a1f3fd6a708a5e"}
Oct 30 20:54:03.170947 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:03.170907    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:54:08.058246 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:08.058133    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-c8m2j" event={"ID":"1a22a4ff-734b-412c-bbe2-57b87c6222f4","Type":"ContainerStarted","Data":"f44172cd33d2c8f191d3f7b4e0941a3b765b859b3bc7b7eda6e331f4ddef1c6c"}
Oct 30 20:54:08.058826 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:08.058315    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-c8m2j"
Oct 30 20:54:08.114381 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:08.114309    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-c8m2j" podStartSLOduration=1.827860952 podStartE2EDuration="7.114293805s" totalImagesPullingTime="5.286432853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:54:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:08.112969535 +0000 UTC m=+915.932481522" watchObservedRunningTime="2026-10-30 20:54:08.114293805 +0000 UTC m=+915.933805794"
Oct 30 20:54:14.093093 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:14.093056    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-c8m2j"
Oct 30 20:54:21.440799 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.440755    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-579cf7c6d-9qdpw"]
Oct 30 20:54:21.459974 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.459937    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-9qdpw"]
Oct 30 20:54:21.460156 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.460061    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-9qdpw"
Oct 30 20:54:21.464961 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.464927    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 30 20:54:21.465912 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.465890    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 30 20:54:21.466031 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.465939    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 30 20:54:21.466031 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.465955    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ss9s9\""
Oct 30 20:54:21.489460 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.489417    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:54:21.547791 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.547752    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45fc43d2-dc02-43fd-b0f0-21860d6e3704-metrics-certs\") pod \"maas-controller-579cf7c6d-9qdpw\" (UID: \"45fc43d2-dc02-43fd-b0f0-21860d6e3704\") " pod="opendatahub/maas-controller-579cf7c6d-9qdpw"
Oct 30 20:54:21.547791 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.547794    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45fc43d2-dc02-43fd-b0f0-21860d6e3704-webhook-cert\") pod \"maas-controller-579cf7c6d-9qdpw\" (UID: \"45fc43d2-dc02-43fd-b0f0-21860d6e3704\") " pod="opendatahub/maas-controller-579cf7c6d-9qdpw"
Oct 30 20:54:21.548053 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.547906    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pttmq\" (UniqueName: \"kubernetes.io/projected/45fc43d2-dc02-43fd-b0f0-21860d6e3704-kube-api-access-pttmq\") pod \"maas-controller-579cf7c6d-9qdpw\" (UID: \"45fc43d2-dc02-43fd-b0f0-21860d6e3704\") " pod="opendatahub/maas-controller-579cf7c6d-9qdpw"
Oct 30 20:54:21.649006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.648961    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45fc43d2-dc02-43fd-b0f0-21860d6e3704-metrics-certs\") pod \"maas-controller-579cf7c6d-9qdpw\" (UID: \"45fc43d2-dc02-43fd-b0f0-21860d6e3704\") " pod="opendatahub/maas-controller-579cf7c6d-9qdpw"
Oct 30 20:54:21.649006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.649009    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45fc43d2-dc02-43fd-b0f0-21860d6e3704-webhook-cert\") pod \"maas-controller-579cf7c6d-9qdpw\" (UID: \"45fc43d2-dc02-43fd-b0f0-21860d6e3704\") " pod="opendatahub/maas-controller-579cf7c6d-9qdpw"
Oct 30 20:54:21.649238 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.649062    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pttmq\" (UniqueName: \"kubernetes.io/projected/45fc43d2-dc02-43fd-b0f0-21860d6e3704-kube-api-access-pttmq\") pod \"maas-controller-579cf7c6d-9qdpw\" (UID: \"45fc43d2-dc02-43fd-b0f0-21860d6e3704\") " pod="opendatahub/maas-controller-579cf7c6d-9qdpw"
Oct 30 20:54:21.651743 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.651710    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45fc43d2-dc02-43fd-b0f0-21860d6e3704-metrics-certs\") pod \"maas-controller-579cf7c6d-9qdpw\" (UID: \"45fc43d2-dc02-43fd-b0f0-21860d6e3704\") " pod="opendatahub/maas-controller-579cf7c6d-9qdpw"
Oct 30 20:54:21.651885 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.651768    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45fc43d2-dc02-43fd-b0f0-21860d6e3704-webhook-cert\") pod \"maas-controller-579cf7c6d-9qdpw\" (UID: \"45fc43d2-dc02-43fd-b0f0-21860d6e3704\") " pod="opendatahub/maas-controller-579cf7c6d-9qdpw"
Oct 30 20:54:21.662948 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.662915    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pttmq\" (UniqueName: \"kubernetes.io/projected/45fc43d2-dc02-43fd-b0f0-21860d6e3704-kube-api-access-pttmq\") pod \"maas-controller-579cf7c6d-9qdpw\" (UID: \"45fc43d2-dc02-43fd-b0f0-21860d6e3704\") " pod="opendatahub/maas-controller-579cf7c6d-9qdpw"
Oct 30 20:54:21.738137 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.738047    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:54:21.773457 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.773311    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-9qdpw"
Oct 30 20:54:21.785013 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.784970    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55d44b6fdc-t2f9k"]
Oct 30 20:54:21.794425 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.794392    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d44b6fdc-t2f9k"
Oct 30 20:54:21.806096 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.806065    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55d44b6fdc-t2f9k"]
Oct 30 20:54:21.850983 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.850935    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-metrics-certs\") pod \"maas-controller-55d44b6fdc-t2f9k\" (UID: \"6473d8f0-9a33-42a1-9353-ab78fd79ba6a\") " pod="opendatahub/maas-controller-55d44b6fdc-t2f9k"
Oct 30 20:54:21.851182 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.851050    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5dfn\" (UniqueName: \"kubernetes.io/projected/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-kube-api-access-j5dfn\") pod \"maas-controller-55d44b6fdc-t2f9k\" (UID: \"6473d8f0-9a33-42a1-9353-ab78fd79ba6a\") " pod="opendatahub/maas-controller-55d44b6fdc-t2f9k"
Oct 30 20:54:21.851182 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.851087    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-webhook-cert\") pod \"maas-controller-55d44b6fdc-t2f9k\" (UID: \"6473d8f0-9a33-42a1-9353-ab78fd79ba6a\") " pod="opendatahub/maas-controller-55d44b6fdc-t2f9k"
Oct 30 20:54:21.948867 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.948829    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:54:21.951799 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.951772    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5dfn\" (UniqueName: \"kubernetes.io/projected/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-kube-api-access-j5dfn\") pod \"maas-controller-55d44b6fdc-t2f9k\" (UID: \"6473d8f0-9a33-42a1-9353-ab78fd79ba6a\") " pod="opendatahub/maas-controller-55d44b6fdc-t2f9k"
Oct 30 20:54:21.951870 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.951817    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-webhook-cert\") pod \"maas-controller-55d44b6fdc-t2f9k\" (UID: \"6473d8f0-9a33-42a1-9353-ab78fd79ba6a\") " pod="opendatahub/maas-controller-55d44b6fdc-t2f9k"
Oct 30 20:54:21.951912 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.951869    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-metrics-certs\") pod \"maas-controller-55d44b6fdc-t2f9k\" (UID: \"6473d8f0-9a33-42a1-9353-ab78fd79ba6a\") " pod="opendatahub/maas-controller-55d44b6fdc-t2f9k"
Oct 30 20:54:21.954560 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.954527    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-webhook-cert\") pod \"maas-controller-55d44b6fdc-t2f9k\" (UID: \"6473d8f0-9a33-42a1-9353-ab78fd79ba6a\") " pod="opendatahub/maas-controller-55d44b6fdc-t2f9k"
Oct 30 20:54:21.954560 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.954545    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-metrics-certs\") pod \"maas-controller-55d44b6fdc-t2f9k\" (UID: \"6473d8f0-9a33-42a1-9353-ab78fd79ba6a\") " pod="opendatahub/maas-controller-55d44b6fdc-t2f9k"
Oct 30 20:54:21.964415 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:21.964354    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5dfn\" (UniqueName: \"kubernetes.io/projected/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-kube-api-access-j5dfn\") pod \"maas-controller-55d44b6fdc-t2f9k\" (UID: \"6473d8f0-9a33-42a1-9353-ab78fd79ba6a\") " pod="opendatahub/maas-controller-55d44b6fdc-t2f9k"
Oct 30 20:54:22.060897 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:22.060829    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-9qdpw"]
Oct 30 20:54:22.063322 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:54:22.063294    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45fc43d2_dc02_43fd_b0f0_21860d6e3704.slice/crio-5f129a7ffb9342c2446e1a8b49c6db2847de7474319a41512cb27eb00c37bcc0 WatchSource:0}: Error finding container 5f129a7ffb9342c2446e1a8b49c6db2847de7474319a41512cb27eb00c37bcc0: Status 404 returned error can't find the container with id 5f129a7ffb9342c2446e1a8b49c6db2847de7474319a41512cb27eb00c37bcc0
Oct 30 20:54:22.113444 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:22.113408    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d44b6fdc-t2f9k"
Oct 30 20:54:22.122597 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:22.122451    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-9qdpw" event={"ID":"45fc43d2-dc02-43fd-b0f0-21860d6e3704","Type":"ContainerStarted","Data":"5f129a7ffb9342c2446e1a8b49c6db2847de7474319a41512cb27eb00c37bcc0"}
Oct 30 20:54:22.395141 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:22.395109    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55d44b6fdc-t2f9k"]
Oct 30 20:54:22.397938 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:54:22.397896    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6473d8f0_9a33_42a1_9353_ab78fd79ba6a.slice/crio-4e9dc100b198e943824683d1dd0df3267697c55be4b6bbe1f26ed3b7b0d1ac3b WatchSource:0}: Error finding container 4e9dc100b198e943824683d1dd0df3267697c55be4b6bbe1f26ed3b7b0d1ac3b: Status 404 returned error can't find the container with id 4e9dc100b198e943824683d1dd0df3267697c55be4b6bbe1f26ed3b7b0d1ac3b
Oct 30 20:54:23.130285 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:23.130242    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d44b6fdc-t2f9k" event={"ID":"6473d8f0-9a33-42a1-9353-ab78fd79ba6a","Type":"ContainerStarted","Data":"4e9dc100b198e943824683d1dd0df3267697c55be4b6bbe1f26ed3b7b0d1ac3b"}
Oct 30 20:54:23.933344 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:54:23.933296    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:54:25.390496 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:25.390464    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:54:25.591881 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:25.591846    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:54:26.149052 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:26.149015    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-9qdpw" event={"ID":"45fc43d2-dc02-43fd-b0f0-21860d6e3704","Type":"ContainerStarted","Data":"9181adf641b1bec2dbbe332a18edd55b3d386cabdf27ce70b3ceb5ad61e0c906"}
Oct 30 20:54:26.149277 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:26.149188    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-579cf7c6d-9qdpw"
Oct 30 20:54:26.150788 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:26.150762    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d44b6fdc-t2f9k" event={"ID":"6473d8f0-9a33-42a1-9353-ab78fd79ba6a","Type":"ContainerStarted","Data":"4b1bd4ecd14b0eba39b559a7aa1608eaad666795e1eb9280dac6b4eb0a99a18d"}
Oct 30 20:54:26.150954 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:26.150900    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55d44b6fdc-t2f9k"
Oct 30 20:54:26.173353 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:26.173296    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-579cf7c6d-9qdpw" podStartSLOduration=2.1822285040000002 podStartE2EDuration="5.173279972s" totalImagesPullingTime="2.991051468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:54:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:26.17272649 +0000 UTC m=+933.992238479" watchObservedRunningTime="2026-10-30 20:54:26.173279972 +0000 UTC m=+933.992791996"
Oct 30 20:54:26.206003 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:26.205935    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-55d44b6fdc-t2f9k" podStartSLOduration=2.328959572 podStartE2EDuration="5.205918643s" totalImagesPullingTime="2.876959071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:54:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:26.204064212 +0000 UTC m=+934.023576203" watchObservedRunningTime="2026-10-30 20:54:26.205918643 +0000 UTC m=+934.025430659"
Oct 30 20:54:26.955428 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:26.955389    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"]
Oct 30 20:54:26.959172 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:26.959144    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"
Oct 30 20:54:26.970809 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:26.970775    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"]
Oct 30 20:54:26.980176 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:26.980141    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Oct 30 20:54:26.980508 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:26.980476    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Oct 30 20:54:26.980602 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:26.980581    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Oct 30 20:54:26.980656 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:26.980639    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-srfw7\""
Oct 30 20:54:27.105048 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:27.104996    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/bd4288f8-819d-42eb-abc4-22e158b6deb6-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9v9tg\" (UID: \"bd4288f8-819d-42eb-abc4-22e158b6deb6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"
Oct 30 20:54:27.105244 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:27.105061    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd4288f8-819d-42eb-abc4-22e158b6deb6-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9v9tg\" (UID: \"bd4288f8-819d-42eb-abc4-22e158b6deb6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"
Oct 30 20:54:27.105244 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:27.105169    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc7bp\" (UniqueName: \"kubernetes.io/projected/bd4288f8-819d-42eb-abc4-22e158b6deb6-kube-api-access-gc7bp\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9v9tg\" (UID: \"bd4288f8-819d-42eb-abc4-22e158b6deb6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"
Oct 30 20:54:27.105244 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:27.105202    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd4288f8-819d-42eb-abc4-22e158b6deb6-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9v9tg\" (UID: \"bd4288f8-819d-42eb-abc4-22e158b6deb6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"
Oct 30 20:54:27.141614 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:27.141568    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:54:27.206670 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:27.206564    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/bd4288f8-819d-42eb-abc4-22e158b6deb6-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9v9tg\" (UID: \"bd4288f8-819d-42eb-abc4-22e158b6deb6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"
Oct 30 20:54:27.206670 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:27.206637    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd4288f8-819d-42eb-abc4-22e158b6deb6-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9v9tg\" (UID: \"bd4288f8-819d-42eb-abc4-22e158b6deb6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"
Oct 30 20:54:27.206670 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:27.206669    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc7bp\" (UniqueName: \"kubernetes.io/projected/bd4288f8-819d-42eb-abc4-22e158b6deb6-kube-api-access-gc7bp\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9v9tg\" (UID: \"bd4288f8-819d-42eb-abc4-22e158b6deb6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"
Oct 30 20:54:27.206944 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:27.206689    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd4288f8-819d-42eb-abc4-22e158b6deb6-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9v9tg\" (UID: \"bd4288f8-819d-42eb-abc4-22e158b6deb6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"
Oct 30 20:54:27.207287 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:27.207266    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd4288f8-819d-42eb-abc4-22e158b6deb6-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9v9tg\" (UID: \"bd4288f8-819d-42eb-abc4-22e158b6deb6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"
Oct 30 20:54:27.207569 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:27.207546    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/bd4288f8-819d-42eb-abc4-22e158b6deb6-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9v9tg\" (UID: \"bd4288f8-819d-42eb-abc4-22e158b6deb6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"
Oct 30 20:54:27.209313 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:27.209290    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd4288f8-819d-42eb-abc4-22e158b6deb6-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9v9tg\" (UID: \"bd4288f8-819d-42eb-abc4-22e158b6deb6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"
Oct 30 20:54:27.232083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:27.232047    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc7bp\" (UniqueName: \"kubernetes.io/projected/bd4288f8-819d-42eb-abc4-22e158b6deb6-kube-api-access-gc7bp\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-9v9tg\" (UID: \"bd4288f8-819d-42eb-abc4-22e158b6deb6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"
Oct 30 20:54:27.274372 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:27.274319    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"
Oct 30 20:54:27.612956 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:27.612919    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"]
Oct 30 20:54:27.616530 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:54:27.616496    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd4288f8_819d_42eb_abc4_22e158b6deb6.slice/crio-bee71cfe384ce18ee49461dba63caa83f5e184e49af7a4100238a1e5d51e21f2 WatchSource:0}: Error finding container bee71cfe384ce18ee49461dba63caa83f5e184e49af7a4100238a1e5d51e21f2: Status 404 returned error can't find the container with id bee71cfe384ce18ee49461dba63caa83f5e184e49af7a4100238a1e5d51e21f2
Oct 30 20:54:27.669905 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:27.669871    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:54:28.160457 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:28.160421    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg" event={"ID":"bd4288f8-819d-42eb-abc4-22e158b6deb6","Type":"ContainerStarted","Data":"bee71cfe384ce18ee49461dba63caa83f5e184e49af7a4100238a1e5d51e21f2"}
Oct 30 20:54:37.158486 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:37.158396    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-579cf7c6d-9qdpw"
Oct 30 20:54:37.158892 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:37.158490    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55d44b6fdc-t2f9k"
Oct 30 20:54:37.233639 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:37.233591    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-9qdpw"]
Oct 30 20:54:37.233849 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:37.233820    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-579cf7c6d-9qdpw" podUID="45fc43d2-dc02-43fd-b0f0-21860d6e3704" containerName="manager" containerID="cri-o://9181adf641b1bec2dbbe332a18edd55b3d386cabdf27ce70b3ceb5ad61e0c906" gracePeriod=30
Oct 30 20:54:37.625102 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:37.625058    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-9qdpw"
Oct 30 20:54:37.709529 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:37.709441    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/45fc43d2-dc02-43fd-b0f0-21860d6e3704-metrics-certs\" (UniqueName: \"kubernetes.io/secret/45fc43d2-dc02-43fd-b0f0-21860d6e3704-metrics-certs\") pod \"45fc43d2-dc02-43fd-b0f0-21860d6e3704\" (UID: \"45fc43d2-dc02-43fd-b0f0-21860d6e3704\") "
Oct 30 20:54:37.709529 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:37.709496    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45fc43d2-dc02-43fd-b0f0-21860d6e3704-kube-api-access-pttmq\" (UniqueName: \"kubernetes.io/projected/45fc43d2-dc02-43fd-b0f0-21860d6e3704-kube-api-access-pttmq\") pod \"45fc43d2-dc02-43fd-b0f0-21860d6e3704\" (UID: \"45fc43d2-dc02-43fd-b0f0-21860d6e3704\") "
Oct 30 20:54:37.709905 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:37.709863    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/45fc43d2-dc02-43fd-b0f0-21860d6e3704-webhook-cert\" (UniqueName: \"kubernetes.io/secret/45fc43d2-dc02-43fd-b0f0-21860d6e3704-webhook-cert\") pod \"45fc43d2-dc02-43fd-b0f0-21860d6e3704\" (UID: \"45fc43d2-dc02-43fd-b0f0-21860d6e3704\") "
Oct 30 20:54:37.712311 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:37.712265    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45fc43d2-dc02-43fd-b0f0-21860d6e3704-metrics-certs" pod "45fc43d2-dc02-43fd-b0f0-21860d6e3704" (UID: "45fc43d2-dc02-43fd-b0f0-21860d6e3704"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:54:37.712493 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:37.712322    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45fc43d2-dc02-43fd-b0f0-21860d6e3704-kube-api-access-pttmq" pod "45fc43d2-dc02-43fd-b0f0-21860d6e3704" (UID: "45fc43d2-dc02-43fd-b0f0-21860d6e3704"). InnerVolumeSpecName "kube-api-access-pttmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:54:37.712493 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:37.712324    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45fc43d2-dc02-43fd-b0f0-21860d6e3704-webhook-cert" pod "45fc43d2-dc02-43fd-b0f0-21860d6e3704" (UID: "45fc43d2-dc02-43fd-b0f0-21860d6e3704"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:54:37.811146 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:37.811111    4948 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45fc43d2-dc02-43fd-b0f0-21860d6e3704-metrics-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:54:37.811146 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:37.811145    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pttmq\" (UniqueName: \"kubernetes.io/projected/45fc43d2-dc02-43fd-b0f0-21860d6e3704-kube-api-access-pttmq\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:54:37.811425 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:37.811158    4948 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45fc43d2-dc02-43fd-b0f0-21860d6e3704-webhook-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:54:38.218443 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:38.218400    4948 generic.go:356] "Generic (PLEG): container finished" podID="45fc43d2-dc02-43fd-b0f0-21860d6e3704" containerID="9181adf641b1bec2dbbe332a18edd55b3d386cabdf27ce70b3ceb5ad61e0c906" exitCode=0
Oct 30 20:54:38.218443 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:38.218440    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-9qdpw" event={"ID":"45fc43d2-dc02-43fd-b0f0-21860d6e3704","Type":"ContainerDied","Data":"9181adf641b1bec2dbbe332a18edd55b3d386cabdf27ce70b3ceb5ad61e0c906"}
Oct 30 20:54:38.219007 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:38.218453    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-9qdpw"
Oct 30 20:54:38.219007 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:38.218505    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-9qdpw" event={"ID":"45fc43d2-dc02-43fd-b0f0-21860d6e3704","Type":"ContainerDied","Data":"5f129a7ffb9342c2446e1a8b49c6db2847de7474319a41512cb27eb00c37bcc0"}
Oct 30 20:54:38.219007 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:38.218533    4948 scope.go:122] "RemoveContainer" containerID="9181adf641b1bec2dbbe332a18edd55b3d386cabdf27ce70b3ceb5ad61e0c906"
Oct 30 20:54:38.229661 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:38.229636    4948 scope.go:122] "RemoveContainer" containerID="9181adf641b1bec2dbbe332a18edd55b3d386cabdf27ce70b3ceb5ad61e0c906"
Oct 30 20:54:38.230031 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:54:38.230008    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9181adf641b1bec2dbbe332a18edd55b3d386cabdf27ce70b3ceb5ad61e0c906\": container with ID starting with 9181adf641b1bec2dbbe332a18edd55b3d386cabdf27ce70b3ceb5ad61e0c906 not found: ID does not exist" containerID="9181adf641b1bec2dbbe332a18edd55b3d386cabdf27ce70b3ceb5ad61e0c906"
Oct 30 20:54:38.230116 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:38.230049    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9181adf641b1bec2dbbe332a18edd55b3d386cabdf27ce70b3ceb5ad61e0c906"} err="failed to get container status \"9181adf641b1bec2dbbe332a18edd55b3d386cabdf27ce70b3ceb5ad61e0c906\": rpc error: code = NotFound desc = could not find container \"9181adf641b1bec2dbbe332a18edd55b3d386cabdf27ce70b3ceb5ad61e0c906\": container with ID starting with 9181adf641b1bec2dbbe332a18edd55b3d386cabdf27ce70b3ceb5ad61e0c906 not found: ID does not exist"
Oct 30 20:54:38.243807 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:38.243772    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-9qdpw"]
Oct 30 20:54:38.248164 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:38.248130    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-9qdpw"]
Oct 30 20:54:38.294436 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:38.294400    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45fc43d2-dc02-43fd-b0f0-21860d6e3704" path="/var/lib/kubelet/pods/45fc43d2-dc02-43fd-b0f0-21860d6e3704/volumes"
Oct 30 20:54:39.224001 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:39.223961    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg" event={"ID":"bd4288f8-819d-42eb-abc4-22e158b6deb6","Type":"ContainerStarted","Data":"58dbcde6466dc41005e6f557a5e29b78e64c2fada6ee36b35718c2973c347587"}
Oct 30 20:54:39.224543 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:39.224072    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"
Oct 30 20:54:39.245781 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:39.245721    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg" podStartSLOduration=2.181418393 podStartE2EDuration="13.24570431s" totalImagesPullingTime="11.064285917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:39.244225683 +0000 UTC m=+947.063737675" watchObservedRunningTime="2026-10-30 20:54:39.24570431 +0000 UTC m=+947.065216298"
Oct 30 20:54:43.423769 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:43.423724    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:54:50.236130 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:50.236093    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-9v9tg"
Oct 30 20:54:53.928033 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:54:53.927993    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:54:55.466616 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:55.466574    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:54:55.671173 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:55.671135    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:54:56.871650 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:56.871608    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:54:56.894665 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:56.894619    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"]
Oct 30 20:54:56.895081 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:56.895061    4948 cpu_manager.go:414] "containerMap: removing container" podUID="45fc43d2-dc02-43fd-b0f0-21860d6e3704" containerName="manager"
Oct 30 20:54:56.895170 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:56.895084    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45fc43d2-dc02-43fd-b0f0-21860d6e3704" containerName="manager"
Oct 30 20:54:56.895222 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:56.895187    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="45fc43d2-dc02-43fd-b0f0-21860d6e3704" containerName="manager"
Oct 30 20:54:56.903221 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:56.903184    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:54:56.909932 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:56.909903    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 20:54:56.910302 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:56.910240    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"]
Oct 30 20:54:56.910498 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:56.910261    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 20:54:56.910650 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:56.910261    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-57jm5\""
Oct 30 20:54:56.976670 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:56.976633    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af6ace13-82d1-490b-846e-a80f20569c06-openshift-service-ca\") pod \"maas-api-6d669c7fcd-r52bs\" (UID: \"af6ace13-82d1-490b-846e-a80f20569c06\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:54:56.976900 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:56.976685    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5r8f\" (UniqueName: \"kubernetes.io/projected/af6ace13-82d1-490b-846e-a80f20569c06-kube-api-access-g5r8f\") pod \"maas-api-6d669c7fcd-r52bs\" (UID: \"af6ace13-82d1-490b-846e-a80f20569c06\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:54:56.976900 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:56.976710    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af6ace13-82d1-490b-846e-a80f20569c06-metrics-certs\") pod \"maas-api-6d669c7fcd-r52bs\" (UID: \"af6ace13-82d1-490b-846e-a80f20569c06\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:54:56.976900 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:56.976806    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af6ace13-82d1-490b-846e-a80f20569c06-maas-api-tls\") pod \"maas-api-6d669c7fcd-r52bs\" (UID: \"af6ace13-82d1-490b-846e-a80f20569c06\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:54:57.078089 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:57.078042    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af6ace13-82d1-490b-846e-a80f20569c06-openshift-service-ca\") pod \"maas-api-6d669c7fcd-r52bs\" (UID: \"af6ace13-82d1-490b-846e-a80f20569c06\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:54:57.078302 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:57.078110    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5r8f\" (UniqueName: \"kubernetes.io/projected/af6ace13-82d1-490b-846e-a80f20569c06-kube-api-access-g5r8f\") pod \"maas-api-6d669c7fcd-r52bs\" (UID: \"af6ace13-82d1-490b-846e-a80f20569c06\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:54:57.078302 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:57.078139    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af6ace13-82d1-490b-846e-a80f20569c06-metrics-certs\") pod \"maas-api-6d669c7fcd-r52bs\" (UID: \"af6ace13-82d1-490b-846e-a80f20569c06\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:54:57.078302 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:57.078181    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af6ace13-82d1-490b-846e-a80f20569c06-maas-api-tls\") pod \"maas-api-6d669c7fcd-r52bs\" (UID: \"af6ace13-82d1-490b-846e-a80f20569c06\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:54:57.078954 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:57.078926    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af6ace13-82d1-490b-846e-a80f20569c06-openshift-service-ca\") pod \"maas-api-6d669c7fcd-r52bs\" (UID: \"af6ace13-82d1-490b-846e-a80f20569c06\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:54:57.081037 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:57.081009    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af6ace13-82d1-490b-846e-a80f20569c06-maas-api-tls\") pod \"maas-api-6d669c7fcd-r52bs\" (UID: \"af6ace13-82d1-490b-846e-a80f20569c06\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:54:57.081037 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:57.081028    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af6ace13-82d1-490b-846e-a80f20569c06-metrics-certs\") pod \"maas-api-6d669c7fcd-r52bs\" (UID: \"af6ace13-82d1-490b-846e-a80f20569c06\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:54:57.091045 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:57.091016    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5r8f\" (UniqueName: \"kubernetes.io/projected/af6ace13-82d1-490b-846e-a80f20569c06-kube-api-access-g5r8f\") pod \"maas-api-6d669c7fcd-r52bs\" (UID: \"af6ace13-82d1-490b-846e-a80f20569c06\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:54:57.097568 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:57.097532    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:54:57.219674 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:57.219585    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:54:57.503638 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:57.503607    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"]
Oct 30 20:54:57.506656 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:54:57.506625    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf6ace13_82d1_490b_846e_a80f20569c06.slice/crio-dade787becd5b0bc2234ea6e4c7a7fe1c75bf49ddc12553ce5263201f195a97f WatchSource:0}: Error finding container dade787becd5b0bc2234ea6e4c7a7fe1c75bf49ddc12553ce5263201f195a97f: Status 404 returned error can't find the container with id dade787becd5b0bc2234ea6e4c7a7fe1c75bf49ddc12553ce5263201f195a97f
Oct 30 20:54:58.321431 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:54:58.321393    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs" event={"ID":"af6ace13-82d1-490b-846e-a80f20569c06","Type":"ContainerStarted","Data":"dade787becd5b0bc2234ea6e4c7a7fe1c75bf49ddc12553ce5263201f195a97f"}
Oct 30 20:55:00.331618 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:00.331581    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs" event={"ID":"af6ace13-82d1-490b-846e-a80f20569c06","Type":"ContainerStarted","Data":"af39920045287dbbd0a45ecba1d60a61b2cf2712c98784acc6436a2477118b12"}
Oct 30 20:55:00.332052 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:00.331652    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:55:00.352561 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:00.352459    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs" podStartSLOduration=2.48981639 podStartE2EDuration="4.352440471s" totalImagesPullingTime="1.862624081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:54:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:55:00.352226135 +0000 UTC m=+968.171738119" watchObservedRunningTime="2026-10-30 20:55:00.352440471 +0000 UTC m=+968.171952459"
Oct 30 20:55:06.342595 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:06.342557    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:55:06.928051 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:06.928012    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:55:07.073628 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.073592    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6dd76875b5-vckc4"]
Oct 30 20:55:07.098645 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.098601    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-vckc4"]
Oct 30 20:55:07.098645 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.098642    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-vckc4"
Oct 30 20:55:07.106749 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.106703    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jp6gl\""
Oct 30 20:55:07.107317 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.107291    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 20:55:07.107434 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.107341    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 20:55:07.107434 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.107345    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Oct 30 20:55:07.108572 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.108550    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-vckc4"]
Oct 30 20:55:07.124923 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:55:07.124885    4948 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gxg2v tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-gxg2v tls-cert]: context canceled" pod="kuadrant-system/authorino-6dd76875b5-vckc4" podUID="6a681890-c56f-4c3c-8a1d-d26e66025907"
Oct 30 20:55:07.141027 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.140992    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:55:07.171591 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.171546    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6a681890-c56f-4c3c-8a1d-d26e66025907-tls-cert\") pod \"authorino-6dd76875b5-vckc4\" (UID: \"6a681890-c56f-4c3c-8a1d-d26e66025907\") " pod="kuadrant-system/authorino-6dd76875b5-vckc4"
Oct 30 20:55:07.171591 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.171595    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxg2v\" (UniqueName: \"kubernetes.io/projected/6a681890-c56f-4c3c-8a1d-d26e66025907-kube-api-access-gxg2v\") pod \"authorino-6dd76875b5-vckc4\" (UID: \"6a681890-c56f-4c3c-8a1d-d26e66025907\") " pod="kuadrant-system/authorino-6dd76875b5-vckc4"
Oct 30 20:55:07.272647 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.272537    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6a681890-c56f-4c3c-8a1d-d26e66025907-tls-cert\") pod \"authorino-6dd76875b5-vckc4\" (UID: \"6a681890-c56f-4c3c-8a1d-d26e66025907\") " pod="kuadrant-system/authorino-6dd76875b5-vckc4"
Oct 30 20:55:07.272647 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.272585    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxg2v\" (UniqueName: \"kubernetes.io/projected/6a681890-c56f-4c3c-8a1d-d26e66025907-kube-api-access-gxg2v\") pod \"authorino-6dd76875b5-vckc4\" (UID: \"6a681890-c56f-4c3c-8a1d-d26e66025907\") " pod="kuadrant-system/authorino-6dd76875b5-vckc4"
Oct 30 20:55:07.275537 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.275486    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"]
Oct 30 20:55:07.275937 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.275916    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6a681890-c56f-4c3c-8a1d-d26e66025907-tls-cert\") pod \"authorino-6dd76875b5-vckc4\" (UID: \"6a681890-c56f-4c3c-8a1d-d26e66025907\") " pod="kuadrant-system/authorino-6dd76875b5-vckc4"
Oct 30 20:55:07.277771 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.277754    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 20:55:07.288338 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.288305    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxg2v\" (UniqueName: \"kubernetes.io/projected/6a681890-c56f-4c3c-8a1d-d26e66025907-kube-api-access-gxg2v\") pod \"authorino-6dd76875b5-vckc4\" (UID: \"6a681890-c56f-4c3c-8a1d-d26e66025907\") " pod="kuadrant-system/authorino-6dd76875b5-vckc4"
Oct 30 20:55:07.292390 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.292327    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"]
Oct 30 20:55:07.361760 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.361727    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-vckc4"
Oct 30 20:55:07.367649 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.367622    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-vckc4"
Oct 30 20:55:07.373204 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.373165    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4ad040-8011-4950-8362-9c6d0d7d42d5-metrics-certs\") pod \"maas-api-6797b9d996-v2mlx\" (UID: \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 20:55:07.373391 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.373233    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b4ad040-8011-4950-8362-9c6d0d7d42d5-maas-api-tls\") pod \"maas-api-6797b9d996-v2mlx\" (UID: \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 20:55:07.373391 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.373347    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b4ad040-8011-4950-8362-9c6d0d7d42d5-openshift-service-ca\") pod \"maas-api-6797b9d996-v2mlx\" (UID: \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 20:55:07.373474 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.373420    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4wjs\" (UniqueName: \"kubernetes.io/projected/4b4ad040-8011-4950-8362-9c6d0d7d42d5-kube-api-access-s4wjs\") pod \"maas-api-6797b9d996-v2mlx\" (UID: \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 20:55:07.474562 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.474517    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6a681890-c56f-4c3c-8a1d-d26e66025907-kube-api-access-gxg2v\" (UniqueName: \"kubernetes.io/projected/6a681890-c56f-4c3c-8a1d-d26e66025907-kube-api-access-gxg2v\") pod \"6a681890-c56f-4c3c-8a1d-d26e66025907\" (UID: \"6a681890-c56f-4c3c-8a1d-d26e66025907\") "
Oct 30 20:55:07.474562 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.474559    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6a681890-c56f-4c3c-8a1d-d26e66025907-tls-cert\" (UniqueName: \"kubernetes.io/secret/6a681890-c56f-4c3c-8a1d-d26e66025907-tls-cert\") pod \"6a681890-c56f-4c3c-8a1d-d26e66025907\" (UID: \"6a681890-c56f-4c3c-8a1d-d26e66025907\") "
Oct 30 20:55:07.474829 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.474684    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b4ad040-8011-4950-8362-9c6d0d7d42d5-openshift-service-ca\") pod \"maas-api-6797b9d996-v2mlx\" (UID: \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 20:55:07.474829 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.474708    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4wjs\" (UniqueName: \"kubernetes.io/projected/4b4ad040-8011-4950-8362-9c6d0d7d42d5-kube-api-access-s4wjs\") pod \"maas-api-6797b9d996-v2mlx\" (UID: \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 20:55:07.474829 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.474739    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4ad040-8011-4950-8362-9c6d0d7d42d5-metrics-certs\") pod \"maas-api-6797b9d996-v2mlx\" (UID: \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 20:55:07.474829 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.474802    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b4ad040-8011-4950-8362-9c6d0d7d42d5-maas-api-tls\") pod \"maas-api-6797b9d996-v2mlx\" (UID: \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 20:55:07.475614 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.475584    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b4ad040-8011-4950-8362-9c6d0d7d42d5-openshift-service-ca\") pod \"maas-api-6797b9d996-v2mlx\" (UID: \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 20:55:07.476970 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.476932    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a681890-c56f-4c3c-8a1d-d26e66025907-tls-cert" pod "6a681890-c56f-4c3c-8a1d-d26e66025907" (UID: "6a681890-c56f-4c3c-8a1d-d26e66025907"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:55:07.477091 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.476988    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a681890-c56f-4c3c-8a1d-d26e66025907-kube-api-access-gxg2v" pod "6a681890-c56f-4c3c-8a1d-d26e66025907" (UID: "6a681890-c56f-4c3c-8a1d-d26e66025907"). InnerVolumeSpecName "kube-api-access-gxg2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:55:07.477275 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.477255    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b4ad040-8011-4950-8362-9c6d0d7d42d5-maas-api-tls\") pod \"maas-api-6797b9d996-v2mlx\" (UID: \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 20:55:07.477327 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.477305    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4ad040-8011-4950-8362-9c6d0d7d42d5-metrics-certs\") pod \"maas-api-6797b9d996-v2mlx\" (UID: \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 20:55:07.490902 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.490855    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4wjs\" (UniqueName: \"kubernetes.io/projected/4b4ad040-8011-4950-8362-9c6d0d7d42d5-kube-api-access-s4wjs\") pod \"maas-api-6797b9d996-v2mlx\" (UID: \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 20:55:07.575716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.575604    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxg2v\" (UniqueName: \"kubernetes.io/projected/6a681890-c56f-4c3c-8a1d-d26e66025907-kube-api-access-gxg2v\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:55:07.575716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.575644    4948 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6a681890-c56f-4c3c-8a1d-d26e66025907-tls-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:55:07.605576 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.605544    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 20:55:07.882709 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:07.882644    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"]
Oct 30 20:55:07.885622 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:55:07.885585    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4ad040_8011_4950_8362_9c6d0d7d42d5.slice/crio-799dd60e9b243922d17f6f5405d0291e3f754ef62a676f8daf406c4b6e2fe220 WatchSource:0}: Error finding container 799dd60e9b243922d17f6f5405d0291e3f754ef62a676f8daf406c4b6e2fe220: Status 404 returned error can't find the container with id 799dd60e9b243922d17f6f5405d0291e3f754ef62a676f8daf406c4b6e2fe220
Oct 30 20:55:08.368528 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:08.368476    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx" event={"ID":"4b4ad040-8011-4950-8362-9c6d0d7d42d5","Type":"ContainerStarted","Data":"f88cc96165185852589dc78e072c3fb35ec50306e8d181c7adc5a184e01ee0f7"}
Oct 30 20:55:08.369026 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:08.368553    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx" event={"ID":"4b4ad040-8011-4950-8362-9c6d0d7d42d5","Type":"ContainerStarted","Data":"799dd60e9b243922d17f6f5405d0291e3f754ef62a676f8daf406c4b6e2fe220"}
Oct 30 20:55:08.369026 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:08.368580    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 20:55:08.369026 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:08.368578    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-vckc4"
Oct 30 20:55:08.389334 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:08.389268    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx" podStartSLOduration=0.988507172 podStartE2EDuration="1.389249805s" totalImagesPullingTime="400.742633ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:55:08.389092005 +0000 UTC m=+976.208603994" watchObservedRunningTime="2026-10-30 20:55:08.389249805 +0000 UTC m=+976.208761792"
Oct 30 20:55:08.417078 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:08.417043    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-vckc4"]
Oct 30 20:55:08.425635 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:08.425598    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-vckc4"]
Oct 30 20:55:10.292816 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:10.292782    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6a681890-c56f-4c3c-8a1d-d26e66025907" path="/var/lib/kubelet/pods/6a681890-c56f-4c3c-8a1d-d26e66025907/volumes"
Oct 30 20:55:14.381295 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:14.381255    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 20:55:14.432574 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:14.432535    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"]
Oct 30 20:55:14.432855 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:14.432830    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs" podUID="af6ace13-82d1-490b-846e-a80f20569c06" containerName="maas-api" containerID="cri-o://af39920045287dbbd0a45ecba1d60a61b2cf2712c98784acc6436a2477118b12" gracePeriod=30
Oct 30 20:55:14.687619 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:14.687585    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:55:14.743706 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:14.743665    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/af6ace13-82d1-490b-846e-a80f20569c06-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af6ace13-82d1-490b-846e-a80f20569c06-openshift-service-ca\") pod \"af6ace13-82d1-490b-846e-a80f20569c06\" (UID: \"af6ace13-82d1-490b-846e-a80f20569c06\") "
Oct 30 20:55:14.743898 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:14.743731    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/af6ace13-82d1-490b-846e-a80f20569c06-metrics-certs\" (UniqueName: \"kubernetes.io/secret/af6ace13-82d1-490b-846e-a80f20569c06-metrics-certs\") pod \"af6ace13-82d1-490b-846e-a80f20569c06\" (UID: \"af6ace13-82d1-490b-846e-a80f20569c06\") "
Oct 30 20:55:14.743898 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:14.743837    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/af6ace13-82d1-490b-846e-a80f20569c06-kube-api-access-g5r8f\" (UniqueName: \"kubernetes.io/projected/af6ace13-82d1-490b-846e-a80f20569c06-kube-api-access-g5r8f\") pod \"af6ace13-82d1-490b-846e-a80f20569c06\" (UID: \"af6ace13-82d1-490b-846e-a80f20569c06\") "
Oct 30 20:55:14.744010 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:14.743912    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/af6ace13-82d1-490b-846e-a80f20569c06-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af6ace13-82d1-490b-846e-a80f20569c06-maas-api-tls\") pod \"af6ace13-82d1-490b-846e-a80f20569c06\" (UID: \"af6ace13-82d1-490b-846e-a80f20569c06\") "
Oct 30 20:55:14.744152 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:14.744128    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af6ace13-82d1-490b-846e-a80f20569c06-openshift-service-ca" pod "af6ace13-82d1-490b-846e-a80f20569c06" (UID: "af6ace13-82d1-490b-846e-a80f20569c06"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:55:14.746192 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:14.746155    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af6ace13-82d1-490b-846e-a80f20569c06-metrics-certs" pod "af6ace13-82d1-490b-846e-a80f20569c06" (UID: "af6ace13-82d1-490b-846e-a80f20569c06"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:55:14.746338 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:14.746189    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af6ace13-82d1-490b-846e-a80f20569c06-maas-api-tls" pod "af6ace13-82d1-490b-846e-a80f20569c06" (UID: "af6ace13-82d1-490b-846e-a80f20569c06"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:55:14.746338 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:14.746254    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af6ace13-82d1-490b-846e-a80f20569c06-kube-api-access-g5r8f" pod "af6ace13-82d1-490b-846e-a80f20569c06" (UID: "af6ace13-82d1-490b-846e-a80f20569c06"). InnerVolumeSpecName "kube-api-access-g5r8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:55:14.845605 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:14.845563    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5r8f\" (UniqueName: \"kubernetes.io/projected/af6ace13-82d1-490b-846e-a80f20569c06-kube-api-access-g5r8f\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:55:14.845605 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:14.845599    4948 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af6ace13-82d1-490b-846e-a80f20569c06-maas-api-tls\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:55:14.845605 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:14.845609    4948 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af6ace13-82d1-490b-846e-a80f20569c06-openshift-service-ca\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:55:14.845605 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:14.845620    4948 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af6ace13-82d1-490b-846e-a80f20569c06-metrics-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:55:15.402148 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:15.402107    4948 generic.go:356] "Generic (PLEG): container finished" podID="af6ace13-82d1-490b-846e-a80f20569c06" containerID="af39920045287dbbd0a45ecba1d60a61b2cf2712c98784acc6436a2477118b12" exitCode=0
Oct 30 20:55:15.402631 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:15.402160    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"
Oct 30 20:55:15.402631 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:15.402197    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs" event={"ID":"af6ace13-82d1-490b-846e-a80f20569c06","Type":"ContainerDied","Data":"af39920045287dbbd0a45ecba1d60a61b2cf2712c98784acc6436a2477118b12"}
Oct 30 20:55:15.402631 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:15.402255    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs" event={"ID":"af6ace13-82d1-490b-846e-a80f20569c06","Type":"ContainerDied","Data":"dade787becd5b0bc2234ea6e4c7a7fe1c75bf49ddc12553ce5263201f195a97f"}
Oct 30 20:55:15.402631 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:15.402278    4948 scope.go:122] "RemoveContainer" containerID="af39920045287dbbd0a45ecba1d60a61b2cf2712c98784acc6436a2477118b12"
Oct 30 20:55:15.412191 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:15.412170    4948 scope.go:122] "RemoveContainer" containerID="af39920045287dbbd0a45ecba1d60a61b2cf2712c98784acc6436a2477118b12"
Oct 30 20:55:15.412542 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:55:15.412519    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af39920045287dbbd0a45ecba1d60a61b2cf2712c98784acc6436a2477118b12\": container with ID starting with af39920045287dbbd0a45ecba1d60a61b2cf2712c98784acc6436a2477118b12 not found: ID does not exist" containerID="af39920045287dbbd0a45ecba1d60a61b2cf2712c98784acc6436a2477118b12"
Oct 30 20:55:15.412591 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:15.412553    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af39920045287dbbd0a45ecba1d60a61b2cf2712c98784acc6436a2477118b12"} err="failed to get container status \"af39920045287dbbd0a45ecba1d60a61b2cf2712c98784acc6436a2477118b12\": rpc error: code = NotFound desc = could not find container \"af39920045287dbbd0a45ecba1d60a61b2cf2712c98784acc6436a2477118b12\": container with ID starting with af39920045287dbbd0a45ecba1d60a61b2cf2712c98784acc6436a2477118b12 not found: ID does not exist"
Oct 30 20:55:15.426715 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:15.426679    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"]
Oct 30 20:55:15.431614 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:15.431582    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-r52bs"]
Oct 30 20:55:16.292605 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:16.292570    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="af6ace13-82d1-490b-846e-a80f20569c06" path="/var/lib/kubelet/pods/af6ace13-82d1-490b-846e-a80f20569c06/volumes"
Oct 30 20:55:23.929254 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:55:23.929207    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:55:43.465552 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:43.465511    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:55:43.726816 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:43.726709    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:55:43.943827 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:43.943782    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:55:53.929488 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:55:53.929448    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:55:59.459847 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.459809    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"]
Oct 30 20:55:59.460271 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.460193    4948 cpu_manager.go:414] "containerMap: removing container" podUID="af6ace13-82d1-490b-846e-a80f20569c06" containerName="maas-api"
Oct 30 20:55:59.460271 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.460205    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="af6ace13-82d1-490b-846e-a80f20569c06" containerName="maas-api"
Oct 30 20:55:59.460374 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.460310    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="af6ace13-82d1-490b-846e-a80f20569c06" containerName="maas-api"
Oct 30 20:55:59.464848 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.464814    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.475116 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.475086    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 30 20:55:59.492146 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.492111    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 30 20:55:59.493546 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.493513    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-75544\""
Oct 30 20:55:59.494136 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.494093    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Oct 30 20:55:59.495535 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.495306    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"]
Oct 30 20:55:59.537802 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.537736    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97ca19de-fe6b-41ee-9bc6-146e7df45955-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.537802 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.537801    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97ca19de-fe6b-41ee-9bc6-146e7df45955-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.538066 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.537925    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97ca19de-fe6b-41ee-9bc6-146e7df45955-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.538066 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.537961    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pwg6\" (UniqueName: \"kubernetes.io/projected/97ca19de-fe6b-41ee-9bc6-146e7df45955-kube-api-access-9pwg6\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.538139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.538070    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97ca19de-fe6b-41ee-9bc6-146e7df45955-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.538139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.538115    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97ca19de-fe6b-41ee-9bc6-146e7df45955-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.639605 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.639557    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97ca19de-fe6b-41ee-9bc6-146e7df45955-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.639605 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.639610    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pwg6\" (UniqueName: \"kubernetes.io/projected/97ca19de-fe6b-41ee-9bc6-146e7df45955-kube-api-access-9pwg6\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.639875 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.639661    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97ca19de-fe6b-41ee-9bc6-146e7df45955-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.639875 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.639701    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97ca19de-fe6b-41ee-9bc6-146e7df45955-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.639875 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.639760    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97ca19de-fe6b-41ee-9bc6-146e7df45955-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.639875 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.639782    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97ca19de-fe6b-41ee-9bc6-146e7df45955-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.640139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.640109    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97ca19de-fe6b-41ee-9bc6-146e7df45955-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.640256 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.640158    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97ca19de-fe6b-41ee-9bc6-146e7df45955-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.640256 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.640169    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97ca19de-fe6b-41ee-9bc6-146e7df45955-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.642539 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.642504    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97ca19de-fe6b-41ee-9bc6-146e7df45955-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.642702 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.642666    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97ca19de-fe6b-41ee-9bc6-146e7df45955-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.650037 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.649996    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:55:59.652716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.652687    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pwg6\" (UniqueName: \"kubernetes.io/projected/97ca19de-fe6b-41ee-9bc6-146e7df45955-kube-api-access-9pwg6\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl\" (UID: \"97ca19de-fe6b-41ee-9bc6-146e7df45955\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:55:59.782246 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:55:59.782134    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:56:00.062668 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:00.062639    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"]
Oct 30 20:56:00.065468 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:56:00.065440    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ca19de_fe6b_41ee_9bc6_146e7df45955.slice/crio-099e6ff10dde2f992b8bbb95a6b85ab217894a25ee8b52ce21f05af35f5c51a6 WatchSource:0}: Error finding container 099e6ff10dde2f992b8bbb95a6b85ab217894a25ee8b52ce21f05af35f5c51a6: Status 404 returned error can't find the container with id 099e6ff10dde2f992b8bbb95a6b85ab217894a25ee8b52ce21f05af35f5c51a6
Oct 30 20:56:00.616228 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:00.616185    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl" event={"ID":"97ca19de-fe6b-41ee-9bc6-146e7df45955","Type":"ContainerStarted","Data":"099e6ff10dde2f992b8bbb95a6b85ab217894a25ee8b52ce21f05af35f5c51a6"}
Oct 30 20:56:01.622407 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:01.622353    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl" event={"ID":"97ca19de-fe6b-41ee-9bc6-146e7df45955","Type":"ContainerStarted","Data":"9364fb0b0e7c63238560f07302b0da75427f003f42c7b0a70367d3b17be559b8"}
Oct 30 20:56:01.643806 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:01.643742    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl" podStartSLOduration=1.381608658 podStartE2EDuration="2.643725263s" totalImagesPullingTime="1.262116605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:01.64314206 +0000 UTC m=+1029.462654059" watchObservedRunningTime="2026-10-30 20:56:01.643725263 +0000 UTC m=+1029.463237297"
Oct 30 20:56:01.782857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:01.782814    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:56:04.747135 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:04.747032    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:56:06.416421 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.416378    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"]
Oct 30 20:56:06.419831 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.419806    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.428100 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.428067    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Oct 30 20:56:06.433504 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.433469    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"]
Oct 30 20:56:06.504306 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.504260    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vx4x\" (UniqueName: \"kubernetes.io/projected/7f4ad782-1866-4c55-b002-615ea7f0ae80-kube-api-access-4vx4x\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.504566 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.504318    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f4ad782-1866-4c55-b002-615ea7f0ae80-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.504566 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.504456    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f4ad782-1866-4c55-b002-615ea7f0ae80-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.504566 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.504499    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f4ad782-1866-4c55-b002-615ea7f0ae80-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.504566 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.504558    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f4ad782-1866-4c55-b002-615ea7f0ae80-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.504710 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.504592    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f4ad782-1866-4c55-b002-615ea7f0ae80-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.572983 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.572944    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:56:06.605882 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.605847    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vx4x\" (UniqueName: \"kubernetes.io/projected/7f4ad782-1866-4c55-b002-615ea7f0ae80-kube-api-access-4vx4x\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.606113 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.605900    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f4ad782-1866-4c55-b002-615ea7f0ae80-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.606113 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.605932    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f4ad782-1866-4c55-b002-615ea7f0ae80-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.606113 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.605948    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f4ad782-1866-4c55-b002-615ea7f0ae80-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.606113 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.605975    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f4ad782-1866-4c55-b002-615ea7f0ae80-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.606113 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.605992    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f4ad782-1866-4c55-b002-615ea7f0ae80-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.606502 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.606480    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f4ad782-1866-4c55-b002-615ea7f0ae80-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.606561 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.606521    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f4ad782-1866-4c55-b002-615ea7f0ae80-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.606597 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.606557    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f4ad782-1866-4c55-b002-615ea7f0ae80-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.608512 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.608489    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f4ad782-1866-4c55-b002-615ea7f0ae80-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.608671 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.608654    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f4ad782-1866-4c55-b002-615ea7f0ae80-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.620121 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.620085    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vx4x\" (UniqueName: \"kubernetes.io/projected/7f4ad782-1866-4c55-b002-615ea7f0ae80-kube-api-access-4vx4x\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28\" (UID: \"7f4ad782-1866-4c55-b002-615ea7f0ae80\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:06.735220 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:06.735097    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:07.020291 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:07.020261    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"]
Oct 30 20:56:07.022042 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:56:07.022011    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4ad782_1866_4c55_b002_615ea7f0ae80.slice/crio-9cc357ab4991f953b0b4f615f1fdfdf5e183ca124172a7b3782a010c789a638e WatchSource:0}: Error finding container 9cc357ab4991f953b0b4f615f1fdfdf5e183ca124172a7b3782a010c789a638e: Status 404 returned error can't find the container with id 9cc357ab4991f953b0b4f615f1fdfdf5e183ca124172a7b3782a010c789a638e
Oct 30 20:56:07.653768 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:07.653729    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28" event={"ID":"7f4ad782-1866-4c55-b002-615ea7f0ae80","Type":"ContainerStarted","Data":"0fff046b21f9e6711a561d3842edf8a95176636566b9354bebe61a9f418fdcf9"}
Oct 30 20:56:07.654181 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:07.653796    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28" event={"ID":"7f4ad782-1866-4c55-b002-615ea7f0ae80","Type":"ContainerStarted","Data":"9cc357ab4991f953b0b4f615f1fdfdf5e183ca124172a7b3782a010c789a638e"}
Oct 30 20:56:07.684539 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:07.684469    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28" podStartSLOduration=1.3890111520000001 podStartE2EDuration="1.684450745s" totalImagesPullingTime="295.439593ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:07.683448802 +0000 UTC m=+1035.502960790" watchObservedRunningTime="2026-10-30 20:56:07.684450745 +0000 UTC m=+1035.503962820"
Oct 30 20:56:07.735778 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:07.735739    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:08.334461 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:08.334425    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:56:09.529419 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:09.529377    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:56:09.783198 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:09.783087    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:56:09.796288 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:09.796257    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:56:10.133131 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.133094    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"]
Oct 30 20:56:10.139460 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.137934    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.146060 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.146029    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Oct 30 20:56:10.149961 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.149924    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"]
Oct 30 20:56:10.241103 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.241062    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c7b1669-f714-4c25-bef4-1435e11b31fd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.241312 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.241185    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c7b1669-f714-4c25-bef4-1435e11b31fd-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.241312 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.241240    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c7b1669-f714-4c25-bef4-1435e11b31fd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.241463 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.241316    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c7b1669-f714-4c25-bef4-1435e11b31fd-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.241463 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.241351    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k88r\" (UniqueName: \"kubernetes.io/projected/4c7b1669-f714-4c25-bef4-1435e11b31fd-kube-api-access-6k88r\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.241463 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.241420    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c7b1669-f714-4c25-bef4-1435e11b31fd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.283147 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.283109    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:56:10.342275 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.342237    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c7b1669-f714-4c25-bef4-1435e11b31fd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.342505 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.342296    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c7b1669-f714-4c25-bef4-1435e11b31fd-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.342505 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.342338    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c7b1669-f714-4c25-bef4-1435e11b31fd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.342505 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.342390    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c7b1669-f714-4c25-bef4-1435e11b31fd-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.342505 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.342420    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k88r\" (UniqueName: \"kubernetes.io/projected/4c7b1669-f714-4c25-bef4-1435e11b31fd-kube-api-access-6k88r\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.342505 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.342457    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c7b1669-f714-4c25-bef4-1435e11b31fd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.342874 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.342849    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c7b1669-f714-4c25-bef4-1435e11b31fd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.342940 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.342897    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c7b1669-f714-4c25-bef4-1435e11b31fd-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.342940 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.342914    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c7b1669-f714-4c25-bef4-1435e11b31fd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.344883 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.344858    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c7b1669-f714-4c25-bef4-1435e11b31fd-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.345056 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.345039    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c7b1669-f714-4c25-bef4-1435e11b31fd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.355342 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.355309    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k88r\" (UniqueName: \"kubernetes.io/projected/4c7b1669-f714-4c25-bef4-1435e11b31fd-kube-api-access-6k88r\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-9pr9k\" (UID: \"4c7b1669-f714-4c25-bef4-1435e11b31fd\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.459142 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.459038    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:10.682078 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.682034    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl"
Oct 30 20:56:10.742521 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:10.742492    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"]
Oct 30 20:56:10.745176 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:56:10.745138    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7b1669_f714_4c25_bef4_1435e11b31fd.slice/crio-bf0b87a49e89daf9471f9020d6bab3225e51e9ecd2c88fa76491c9f6a180a5ad WatchSource:0}: Error finding container bf0b87a49e89daf9471f9020d6bab3225e51e9ecd2c88fa76491c9f6a180a5ad: Status 404 returned error can't find the container with id bf0b87a49e89daf9471f9020d6bab3225e51e9ecd2c88fa76491c9f6a180a5ad
Oct 30 20:56:11.678307 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:11.678263    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k" event={"ID":"4c7b1669-f714-4c25-bef4-1435e11b31fd","Type":"ContainerStarted","Data":"4cfd9f76795ecab44efc1654c799b19e1e531b1312a6f361ee78e5a8f9fe4640"}
Oct 30 20:56:11.678568 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:11.678329    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k" event={"ID":"4c7b1669-f714-4c25-bef4-1435e11b31fd","Type":"ContainerStarted","Data":"bf0b87a49e89daf9471f9020d6bab3225e51e9ecd2c88fa76491c9f6a180a5ad"}
Oct 30 20:56:11.704717 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:11.704656    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k" podStartSLOduration=1.379338174 podStartE2EDuration="1.704639771s" totalImagesPullingTime="325.301597ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:11.701715546 +0000 UTC m=+1039.521227535" watchObservedRunningTime="2026-10-30 20:56:11.704639771 +0000 UTC m=+1039.524151759"
Oct 30 20:56:11.839310 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:11.839273    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:56:12.459569 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:12.459523    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:13.229792 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:13.229741    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:56:15.014919 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.014880    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-t7btd"]
Oct 30 20:56:15.018651 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.018623    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.028312 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.028281    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\""
Oct 30 20:56:15.028701 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.028675    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-t7btd"]
Oct 30 20:56:15.086502 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.086452    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgp6c\" (UniqueName: \"kubernetes.io/projected/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-kube-api-access-xgp6c\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.086702 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.086510    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-home\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.086702 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.086627    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.086702 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.086662    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.086817 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.086726    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.086817 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.086764    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.175045 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.174995    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:56:15.187717 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.187678    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.187912 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.187742    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgp6c\" (UniqueName: \"kubernetes.io/projected/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-kube-api-access-xgp6c\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.187912 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.187769    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-home\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.187912 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.187793    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.187912 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.187812    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.187912 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.187857    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.188189 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.188145    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.188246 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.188203    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-home\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.188320 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.188299    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.190240 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.190207    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.190614 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.190594    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.201099 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.201043    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgp6c\" (UniqueName: \"kubernetes.io/projected/86a4c2e8-bcd1-4b05-89f8-a968f0d4addc-kube-api-access-xgp6c\") pod \"echo-simulator-kserve-64b6f8f96c-t7btd\" (UID: \"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc\") " pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.336454 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.336407    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:15.617320 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.617293    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-t7btd"]
Oct 30 20:56:15.619616 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:56:15.619584    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86a4c2e8_bcd1_4b05_89f8_a968f0d4addc.slice/crio-e5964bfdb8d3e86b2331f4661780054a62d3470e2eef9e5372e2f70891fc8835 WatchSource:0}: Error finding container e5964bfdb8d3e86b2331f4661780054a62d3470e2eef9e5372e2f70891fc8835: Status 404 returned error can't find the container with id e5964bfdb8d3e86b2331f4661780054a62d3470e2eef9e5372e2f70891fc8835
Oct 30 20:56:15.699727 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:15.699686    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd" event={"ID":"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc","Type":"ContainerStarted","Data":"e5964bfdb8d3e86b2331f4661780054a62d3470e2eef9e5372e2f70891fc8835"}
Oct 30 20:56:16.736288 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:16.736254    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:16.751682 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:16.751644    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:17.711475 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:17.711432    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd" event={"ID":"86a4c2e8-bcd1-4b05-89f8-a968f0d4addc","Type":"ContainerStarted","Data":"d5010cafcf083e1ff013a4807a558ad0f97554f8c3b3a476fc20b5a8386c11dd"}
Oct 30 20:56:17.723068 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:17.723029    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28"
Oct 30 20:56:17.731671 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:17.731615    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd" podStartSLOduration=1.780630288 podStartE2EDuration="3.731600835s" totalImagesPullingTime="1.950970547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:17.730538969 +0000 UTC m=+1045.550050987" watchObservedRunningTime="2026-10-30 20:56:17.731600835 +0000 UTC m=+1045.551112822"
Oct 30 20:56:18.336634 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:18.336582    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:20.459929 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:20.459881    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:20.473440 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:20.473401    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:20.738208 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:20.738117    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 20:56:23.928962 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:56:23.928918    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:56:24.249825 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.249734    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"]
Oct 30 20:56:24.253822 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.253795    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.258220 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.258190    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6qg5v\""
Oct 30 20:56:24.269710 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.269674    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"]
Oct 30 20:56:24.377658 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.377619    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.377658 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.377655    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.377901 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.377680    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.377901 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.377807    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4beb25f6-a162-490a-9695-700ce6cc8d46-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.377901 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.377852    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.378005 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.377923    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.378005 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.377950    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.378005 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.377975    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.378107 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.378005    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zzhs\" (UniqueName: \"kubernetes.io/projected/4beb25f6-a162-490a-9695-700ce6cc8d46-kube-api-access-4zzhs\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.478764 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.478719    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.478980 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.478774    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zzhs\" (UniqueName: \"kubernetes.io/projected/4beb25f6-a162-490a-9695-700ce6cc8d46-kube-api-access-4zzhs\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.478980 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.478832    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.478980 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.478849    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.478980 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.478866    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.478980 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.478903    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4beb25f6-a162-490a-9695-700ce6cc8d46-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.478980 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.478944    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.479293 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.478999    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.479293 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.479033    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.479457 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.479430    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.479521 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.479487    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.479583 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.479518    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.479638 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.479586    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.480078 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.480052    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4beb25f6-a162-490a-9695-700ce6cc8d46-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.481377 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.481336    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.481629 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.481605    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.492921 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.492891    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.493079 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.493065    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zzhs\" (UniqueName: \"kubernetes.io/projected/4beb25f6-a162-490a-9695-700ce6cc8d46-kube-api-access-4zzhs\") pod \"maas-default-gateway-openshift-default-58c6585447-qzbl9\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.567663 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.567562    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:24.853448 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:24.853408    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"]
Oct 30 20:56:24.855814 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:56:24.855783    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4beb25f6_a162_490a_9695_700ce6cc8d46.slice/crio-cacddbafa8d06e89dede9c15cea25f9d1c246939f4066cb21593a5e06ef042d7 WatchSource:0}: Error finding container cacddbafa8d06e89dede9c15cea25f9d1c246939f4066cb21593a5e06ef042d7: Status 404 returned error can't find the container with id cacddbafa8d06e89dede9c15cea25f9d1c246939f4066cb21593a5e06ef042d7
Oct 30 20:56:25.337189 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:25.337150    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:25.350406 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:25.350352    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:25.752905 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:25.752802    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9" event={"ID":"4beb25f6-a162-490a-9695-700ce6cc8d46","Type":"ContainerStarted","Data":"cacddbafa8d06e89dede9c15cea25f9d1c246939f4066cb21593a5e06ef042d7"}
Oct 30 20:56:25.764544 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:25.764505    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd"
Oct 30 20:56:27.336354 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:27.336312    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"]
Oct 30 20:56:27.344264 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:27.344223    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"
Oct 30 20:56:27.349607 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:27.349564    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"]
Oct 30 20:56:27.350965 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:27.350937    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Oct 30 20:56:27.352114 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:27.352089    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\""
Oct 30 20:56:27.352234 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:27.352119    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-hfjnx\""
Oct 30 20:56:27.421600 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:27.421563    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:56:27.510484 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:27.510444    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jwsh\" (UniqueName: \"kubernetes.io/projected/804fadee-a136-472e-b6c6-c1bf4049a6cd-kube-api-access-2jwsh\") pod \"ai-gateway-controller-66dd76bf94-7p9l7\" (UID: \"804fadee-a136-472e-b6c6-c1bf4049a6cd\") " pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"
Oct 30 20:56:27.510707 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:27.510506    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/804fadee-a136-472e-b6c6-c1bf4049a6cd-metrics-certs\") pod \"ai-gateway-controller-66dd76bf94-7p9l7\" (UID: \"804fadee-a136-472e-b6c6-c1bf4049a6cd\") " pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"
Oct 30 20:56:27.611202 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:27.611115    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jwsh\" (UniqueName: \"kubernetes.io/projected/804fadee-a136-472e-b6c6-c1bf4049a6cd-kube-api-access-2jwsh\") pod \"ai-gateway-controller-66dd76bf94-7p9l7\" (UID: \"804fadee-a136-472e-b6c6-c1bf4049a6cd\") " pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"
Oct 30 20:56:27.611202 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:27.611187    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/804fadee-a136-472e-b6c6-c1bf4049a6cd-metrics-certs\") pod \"ai-gateway-controller-66dd76bf94-7p9l7\" (UID: \"804fadee-a136-472e-b6c6-c1bf4049a6cd\") " pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"
Oct 30 20:56:27.614231 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:27.614199    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/804fadee-a136-472e-b6c6-c1bf4049a6cd-metrics-certs\") pod \"ai-gateway-controller-66dd76bf94-7p9l7\" (UID: \"804fadee-a136-472e-b6c6-c1bf4049a6cd\") " pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"
Oct 30 20:56:27.624864 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:27.624829    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jwsh\" (UniqueName: \"kubernetes.io/projected/804fadee-a136-472e-b6c6-c1bf4049a6cd-kube-api-access-2jwsh\") pod \"ai-gateway-controller-66dd76bf94-7p9l7\" (UID: \"804fadee-a136-472e-b6c6-c1bf4049a6cd\") " pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"
Oct 30 20:56:27.625849 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:27.625757    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:56:27.662281 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:27.662240    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"
Oct 30 20:56:27.952952 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:27.952922    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"]
Oct 30 20:56:27.955742 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:56:27.955712    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod804fadee_a136_472e_b6c6_c1bf4049a6cd.slice/crio-76965029cfad107308076165419c483639288e1c6dde5b704b7e7700b8293835 WatchSource:0}: Error finding container 76965029cfad107308076165419c483639288e1c6dde5b704b7e7700b8293835: Status 404 returned error can't find the container with id 76965029cfad107308076165419c483639288e1c6dde5b704b7e7700b8293835
Oct 30 20:56:28.021381 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:28.021327    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:56:28.021515 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:28.021457    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:56:28.021515 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:28.021505    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:56:28.783265 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:28.783168    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9" event={"ID":"4beb25f6-a162-490a-9695-700ce6cc8d46","Type":"ContainerStarted","Data":"c29c24a3a4eb29a4a749a46015a04472d89b316cbe3f387d91526fbee61548d2"}
Oct 30 20:56:28.785066 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:28.785027    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7" event={"ID":"804fadee-a136-472e-b6c6-c1bf4049a6cd","Type":"ContainerStarted","Data":"76965029cfad107308076165419c483639288e1c6dde5b704b7e7700b8293835"}
Oct 30 20:56:28.809720 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:28.809651    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9" podStartSLOduration=1.64726023 podStartE2EDuration="4.809627028s" totalImagesPullingTime="3.162366798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:28.807671662 +0000 UTC m=+1056.627183651" watchObservedRunningTime="2026-10-30 20:56:28.809627028 +0000 UTC m=+1056.629139018"
Oct 30 20:56:29.572832 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:29.571865    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:29.575948 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:29.575909    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-qzbl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Oct 30 20:56:29.576173 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:29.575983    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9" podUID="4beb25f6-a162-490a-9695-700ce6cc8d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Oct 30 20:56:29.793978 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:29.793939    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7" event={"ID":"804fadee-a136-472e-b6c6-c1bf4049a6cd","Type":"ContainerStarted","Data":"e4a3390f7cea1d8e47924863f33c1092f1cbb08f9cfc828b18efd7e005c6d708"}
Oct 30 20:56:29.814586 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:29.814521    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7" podStartSLOduration=1.093481743 podStartE2EDuration="2.814504386s" totalImagesPullingTime="1.721022643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:29.812870347 +0000 UTC m=+1057.632382338" watchObservedRunningTime="2026-10-30 20:56:29.814504386 +0000 UTC m=+1057.634016374"
Oct 30 20:56:30.570386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:30.568939    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-qzbl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Oct 30 20:56:30.570386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:30.569022    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9" podUID="4beb25f6-a162-490a-9695-700ce6cc8d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Oct 30 20:56:30.799192 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:30.799157    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"
Oct 30 20:56:31.575501 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.574045    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-qzbl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Oct 30 20:56:31.575501 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.574116    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9" podUID="4beb25f6-a162-490a-9695-700ce6cc8d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Oct 30 20:56:31.700473 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.700423    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-sngkx"]
Oct 30 20:56:31.704315 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.704290    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-sngkx"
Oct 30 20:56:31.719324 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.719271    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-sngkx"]
Oct 30 20:56:31.720663 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.720637    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wdjg7\""
Oct 30 20:56:31.732650 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.732595    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:56:31.741228 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.741193    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-shr5q"]
Oct 30 20:56:31.745142 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.745114    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-shr5q"
Oct 30 20:56:31.781244 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.776186    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Oct 30 20:56:31.806274 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.804579    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-shr5q"]
Oct 30 20:56:31.877048 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.876630    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wml6b\" (UniqueName: \"kubernetes.io/projected/16b64490-6c2c-433e-8289-02110c8c0d94-kube-api-access-wml6b\") pod \"payload-processing-5f78687d5b-shr5q\" (UID: \"16b64490-6c2c-433e-8289-02110c8c0d94\") " pod="openshift-ingress/payload-processing-5f78687d5b-shr5q"
Oct 30 20:56:31.877048 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.876708    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsp5z\" (UniqueName: \"kubernetes.io/projected/588d49fd-02d6-4223-84e1-3053a065054b-kube-api-access-nsp5z\") pod \"payload-pre-processing-7b98bb678c-sngkx\" (UID: \"588d49fd-02d6-4223-84e1-3053a065054b\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-sngkx"
Oct 30 20:56:31.877048 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.876820    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/588d49fd-02d6-4223-84e1-3053a065054b-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-sngkx\" (UID: \"588d49fd-02d6-4223-84e1-3053a065054b\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-sngkx"
Oct 30 20:56:31.877048 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.876845    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16b64490-6c2c-433e-8289-02110c8c0d94-plugins-config-volume\") pod \"payload-processing-5f78687d5b-shr5q\" (UID: \"16b64490-6c2c-433e-8289-02110c8c0d94\") " pod="openshift-ingress/payload-processing-5f78687d5b-shr5q"
Oct 30 20:56:31.938555 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.938503    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:56:31.978165 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.978119    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/588d49fd-02d6-4223-84e1-3053a065054b-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-sngkx\" (UID: \"588d49fd-02d6-4223-84e1-3053a065054b\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-sngkx"
Oct 30 20:56:31.978165 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.978163    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16b64490-6c2c-433e-8289-02110c8c0d94-plugins-config-volume\") pod \"payload-processing-5f78687d5b-shr5q\" (UID: \"16b64490-6c2c-433e-8289-02110c8c0d94\") " pod="openshift-ingress/payload-processing-5f78687d5b-shr5q"
Oct 30 20:56:31.978468 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.978211    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wml6b\" (UniqueName: \"kubernetes.io/projected/16b64490-6c2c-433e-8289-02110c8c0d94-kube-api-access-wml6b\") pod \"payload-processing-5f78687d5b-shr5q\" (UID: \"16b64490-6c2c-433e-8289-02110c8c0d94\") " pod="openshift-ingress/payload-processing-5f78687d5b-shr5q"
Oct 30 20:56:31.978468 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.978236    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsp5z\" (UniqueName: \"kubernetes.io/projected/588d49fd-02d6-4223-84e1-3053a065054b-kube-api-access-nsp5z\") pod \"payload-pre-processing-7b98bb678c-sngkx\" (UID: \"588d49fd-02d6-4223-84e1-3053a065054b\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-sngkx"
Oct 30 20:56:31.979475 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.979444    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/588d49fd-02d6-4223-84e1-3053a065054b-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-sngkx\" (UID: \"588d49fd-02d6-4223-84e1-3053a065054b\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-sngkx"
Oct 30 20:56:31.980224 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.980198    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16b64490-6c2c-433e-8289-02110c8c0d94-plugins-config-volume\") pod \"payload-processing-5f78687d5b-shr5q\" (UID: \"16b64490-6c2c-433e-8289-02110c8c0d94\") " pod="openshift-ingress/payload-processing-5f78687d5b-shr5q"
Oct 30 20:56:31.991774 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.991728    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsp5z\" (UniqueName: \"kubernetes.io/projected/588d49fd-02d6-4223-84e1-3053a065054b-kube-api-access-nsp5z\") pod \"payload-pre-processing-7b98bb678c-sngkx\" (UID: \"588d49fd-02d6-4223-84e1-3053a065054b\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-sngkx"
Oct 30 20:56:31.992228 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:31.992205    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wml6b\" (UniqueName: \"kubernetes.io/projected/16b64490-6c2c-433e-8289-02110c8c0d94-kube-api-access-wml6b\") pod \"payload-processing-5f78687d5b-shr5q\" (UID: \"16b64490-6c2c-433e-8289-02110c8c0d94\") " pod="openshift-ingress/payload-processing-5f78687d5b-shr5q"
Oct 30 20:56:32.018183 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:32.018137    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-sngkx"
Oct 30 20:56:32.110401 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:32.109297    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-shr5q"
Oct 30 20:56:32.322232 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:32.322196    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-sngkx"]
Oct 30 20:56:32.325028 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:56:32.324997    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod588d49fd_02d6_4223_84e1_3053a065054b.slice/crio-25fd2d18ea68bf79c14db3485801e6ab93951978e2ace602e95deadfde0bdd80 WatchSource:0}: Error finding container 25fd2d18ea68bf79c14db3485801e6ab93951978e2ace602e95deadfde0bdd80: Status 404 returned error can't find the container with id 25fd2d18ea68bf79c14db3485801e6ab93951978e2ace602e95deadfde0bdd80
Oct 30 20:56:32.415720 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:32.415694    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-shr5q"]
Oct 30 20:56:32.418469 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:56:32.418435    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b64490_6c2c_433e_8289_02110c8c0d94.slice/crio-80dd1b4c362abf553261ced1a8c70d9892d85fadcfeac9386ba6aca0f68dd7f0 WatchSource:0}: Error finding container 80dd1b4c362abf553261ced1a8c70d9892d85fadcfeac9386ba6aca0f68dd7f0: Status 404 returned error can't find the container with id 80dd1b4c362abf553261ced1a8c70d9892d85fadcfeac9386ba6aca0f68dd7f0
Oct 30 20:56:32.574735 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:32.574588    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-qzbl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Oct 30 20:56:32.575004 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:32.574957    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9" podUID="4beb25f6-a162-490a-9695-700ce6cc8d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Oct 30 20:56:32.819099 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:32.819053    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-sngkx" event={"ID":"588d49fd-02d6-4223-84e1-3053a065054b","Type":"ContainerStarted","Data":"25fd2d18ea68bf79c14db3485801e6ab93951978e2ace602e95deadfde0bdd80"}
Oct 30 20:56:32.820318 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:32.820290    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-shr5q" event={"ID":"16b64490-6c2c-433e-8289-02110c8c0d94","Type":"ContainerStarted","Data":"80dd1b4c362abf553261ced1a8c70d9892d85fadcfeac9386ba6aca0f68dd7f0"}
Oct 30 20:56:33.576522 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:33.574742    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-qzbl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Oct 30 20:56:33.576522 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:33.574802    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9" podUID="4beb25f6-a162-490a-9695-700ce6cc8d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Oct 30 20:56:34.568423 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:34.568355    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-qzbl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Oct 30 20:56:34.568955 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:34.568456    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9" podUID="4beb25f6-a162-490a-9695-700ce6cc8d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Oct 30 20:56:35.569086 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:35.568985    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-qzbl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Oct 30 20:56:35.569086 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:35.569053    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9" podUID="4beb25f6-a162-490a-9695-700ce6cc8d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Oct 30 20:56:35.839634 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:35.839592    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-sngkx" event={"ID":"588d49fd-02d6-4223-84e1-3053a065054b","Type":"ContainerStarted","Data":"007385ae5bf6a68e0e4dd64589e460a2819263badafdcdb71f40b4b08723206c"}
Oct 30 20:56:35.839831 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:35.839783    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-sngkx"
Oct 30 20:56:35.841449 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:35.841408    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-shr5q" event={"ID":"16b64490-6c2c-433e-8289-02110c8c0d94","Type":"ContainerStarted","Data":"428e4b931479a6643256fe1a94762f8ab848f873d3ad8b4f0c152469c5434e29"}
Oct 30 20:56:35.841618 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:35.841484    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5f78687d5b-shr5q"
Oct 30 20:56:35.859037 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:35.858977    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-sngkx" podStartSLOduration=1.919874309 podStartE2EDuration="4.858959192s" totalImagesPullingTime="2.939084883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:35.857834141 +0000 UTC m=+1063.677346128" watchObservedRunningTime="2026-10-30 20:56:35.858959192 +0000 UTC m=+1063.678471181"
Oct 30 20:56:35.876432 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:35.876351    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5f78687d5b-shr5q" podStartSLOduration=1.9227205299999999 podStartE2EDuration="4.876333536s" totalImagesPullingTime="2.953613006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:35.874974537 +0000 UTC m=+1063.694486535" watchObservedRunningTime="2026-10-30 20:56:35.876333536 +0000 UTC m=+1063.695845524"
Oct 30 20:56:37.568824 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:37.568769    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-qzbl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:56:37.569375 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:37.568901    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9" podUID="4beb25f6-a162-490a-9695-700ce6cc8d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:38.610685 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:38.610630    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-qzbl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:56:38.611276 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:38.610739    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9" podUID="4beb25f6-a162-490a-9695-700ce6cc8d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:38.963931 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:38.963841    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:38.964230 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:38.964203    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:38.965439 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:38.965411    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 20:56:39.289818 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.289723    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"]
Oct 30 20:56:39.293993 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.293961    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.305852 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.305765    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"]
Oct 30 20:56:39.346632 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.346591    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.346842 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.346668    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.346842 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.346692    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.346842 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.346707    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zwln\" (UniqueName: \"kubernetes.io/projected/14f0cd2f-1f47-44dc-a972-e3be6850859e-kube-api-access-6zwln\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.346842 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.346813    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.347019 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.346847    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.347019 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.346874    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14f0cd2f-1f47-44dc-a972-e3be6850859e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.347019 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.346983    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.347019 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.347003    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.448292 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.448253    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.448292 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.448295    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.448651 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.448312    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.448651 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.448343    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zwln\" (UniqueName: \"kubernetes.io/projected/14f0cd2f-1f47-44dc-a972-e3be6850859e-kube-api-access-6zwln\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.448651 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.448410    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.448651 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.448440    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.448651 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.448473    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14f0cd2f-1f47-44dc-a972-e3be6850859e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.448651 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.448541    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.448651 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.448569    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.448982 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.448870    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.449146 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.449101    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.449146 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.449119    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.449295 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.449163    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.449340 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.449309    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14f0cd2f-1f47-44dc-a972-e3be6850859e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.450970 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.450950    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.451083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.451011    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.469669 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.469636    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zwln\" (UniqueName: \"kubernetes.io/projected/14f0cd2f-1f47-44dc-a972-e3be6850859e-kube-api-access-6zwln\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.491184 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.491153    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-ls72z\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.613232 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.613189    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:39.905720 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.905690    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"]
Oct 30 20:56:39.907591 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:56:39.907556    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f0cd2f_1f47_44dc_a972_e3be6850859e.slice/crio-d9524f00e95419c60c9fe29f1b002b4f2a5cf859573a61786fac1da7a75f814f WatchSource:0}: Error finding container d9524f00e95419c60c9fe29f1b002b4f2a5cf859573a61786fac1da7a75f814f: Status 404 returned error can't find the container with id d9524f00e95419c60c9fe29f1b002b4f2a5cf859573a61786fac1da7a75f814f
Oct 30 20:56:39.910848 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.910815    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:56:39.910922 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.910889    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:56:39.910955 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:39.910922    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:56:40.879628 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:40.879588    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z" event={"ID":"14f0cd2f-1f47-44dc-a972-e3be6850859e","Type":"ContainerStarted","Data":"49a923826b0a0433dcb1011eba7ff1e488dd5ff1d539ba4627854f58312e16fe"}
Oct 30 20:56:40.880044 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:40.879647    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z" event={"ID":"14f0cd2f-1f47-44dc-a972-e3be6850859e","Type":"ContainerStarted","Data":"d9524f00e95419c60c9fe29f1b002b4f2a5cf859573a61786fac1da7a75f814f"}
Oct 30 20:56:40.907911 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:40.907847    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z" podStartSLOduration=1.907829602 podStartE2EDuration="1.907829602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:40.906707477 +0000 UTC m=+1068.726219467" watchObservedRunningTime="2026-10-30 20:56:40.907829602 +0000 UTC m=+1068.727341590"
Oct 30 20:56:41.613949 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:41.613907    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:41.615782 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:41.615750    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-ls72z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Oct 30 20:56:41.615955 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:41.615815    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z" podUID="14f0cd2f-1f47-44dc-a972-e3be6850859e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Oct 30 20:56:41.816243 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:41.816208    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"
Oct 30 20:56:42.613930 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:42.613889    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-ls72z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Oct 30 20:56:42.614398 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:42.613964    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z" podUID="14f0cd2f-1f47-44dc-a972-e3be6850859e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Oct 30 20:56:43.534093 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:43.534053    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:56:43.614188 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:43.614152    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-ls72z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Oct 30 20:56:43.614613 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:43.614224    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z" podUID="14f0cd2f-1f47-44dc-a972-e3be6850859e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Oct 30 20:56:44.614004 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:44.613958    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-ls72z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Oct 30 20:56:44.614204 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:44.614026    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z" podUID="14f0cd2f-1f47-44dc-a972-e3be6850859e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Oct 30 20:56:45.613897 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:45.613853    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-ls72z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Oct 30 20:56:45.614402 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:45.613912    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z" podUID="14f0cd2f-1f47-44dc-a972-e3be6850859e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Oct 30 20:56:46.613684 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:46.613637    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-ls72z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Oct 30 20:56:46.614023 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:46.613727    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z" podUID="14f0cd2f-1f47-44dc-a972-e3be6850859e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Oct 30 20:56:46.851700 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:46.851657    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5f78687d5b-shr5q"
Oct 30 20:56:46.851900 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:46.851753    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-sngkx"
Oct 30 20:56:48.403610 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:48.403571    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:48.404388 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:48.404332    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:48.405154 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:48.405135    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 20:56:53.929031 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:56:53.928982    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:56:56.868986 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:56.868940    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"]
Oct 30 20:56:56.869527 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:56.869188    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7" podUID="804fadee-a136-472e-b6c6-c1bf4049a6cd" containerName="manager" containerID="cri-o://e4a3390f7cea1d8e47924863f33c1092f1cbb08f9cfc828b18efd7e005c6d708" gracePeriod=30
Oct 30 20:56:57.128448 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:57.128355    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"
Oct 30 20:56:57.232158 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:57.232111    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/804fadee-a136-472e-b6c6-c1bf4049a6cd-kube-api-access-2jwsh\" (UniqueName: \"kubernetes.io/projected/804fadee-a136-472e-b6c6-c1bf4049a6cd-kube-api-access-2jwsh\") pod \"804fadee-a136-472e-b6c6-c1bf4049a6cd\" (UID: \"804fadee-a136-472e-b6c6-c1bf4049a6cd\") "
Oct 30 20:56:57.232352 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:57.232280    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/804fadee-a136-472e-b6c6-c1bf4049a6cd-metrics-certs\" (UniqueName: \"kubernetes.io/secret/804fadee-a136-472e-b6c6-c1bf4049a6cd-metrics-certs\") pod \"804fadee-a136-472e-b6c6-c1bf4049a6cd\" (UID: \"804fadee-a136-472e-b6c6-c1bf4049a6cd\") "
Oct 30 20:56:57.234504 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:57.234464    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/804fadee-a136-472e-b6c6-c1bf4049a6cd-metrics-certs" pod "804fadee-a136-472e-b6c6-c1bf4049a6cd" (UID: "804fadee-a136-472e-b6c6-c1bf4049a6cd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:56:57.234608 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:57.234520    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/804fadee-a136-472e-b6c6-c1bf4049a6cd-kube-api-access-2jwsh" pod "804fadee-a136-472e-b6c6-c1bf4049a6cd" (UID: "804fadee-a136-472e-b6c6-c1bf4049a6cd"). InnerVolumeSpecName "kube-api-access-2jwsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:57.333658 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:57.333613    4948 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/804fadee-a136-472e-b6c6-c1bf4049a6cd-metrics-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:57.333658 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:57.333647    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jwsh\" (UniqueName: \"kubernetes.io/projected/804fadee-a136-472e-b6c6-c1bf4049a6cd-kube-api-access-2jwsh\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:57.968986 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:57.968948    4948 generic.go:356] "Generic (PLEG): container finished" podID="804fadee-a136-472e-b6c6-c1bf4049a6cd" containerID="e4a3390f7cea1d8e47924863f33c1092f1cbb08f9cfc828b18efd7e005c6d708" exitCode=0
Oct 30 20:56:57.969482 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:57.968996    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"
Oct 30 20:56:57.969482 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:57.969035    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7" event={"ID":"804fadee-a136-472e-b6c6-c1bf4049a6cd","Type":"ContainerDied","Data":"e4a3390f7cea1d8e47924863f33c1092f1cbb08f9cfc828b18efd7e005c6d708"}
Oct 30 20:56:57.969482 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:57.969093    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-66dd76bf94-7p9l7" event={"ID":"804fadee-a136-472e-b6c6-c1bf4049a6cd","Type":"ContainerDied","Data":"76965029cfad107308076165419c483639288e1c6dde5b704b7e7700b8293835"}
Oct 30 20:56:57.969482 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:57.969118    4948 scope.go:122] "RemoveContainer" containerID="e4a3390f7cea1d8e47924863f33c1092f1cbb08f9cfc828b18efd7e005c6d708"
Oct 30 20:56:57.981970 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:57.981933    4948 scope.go:122] "RemoveContainer" containerID="e4a3390f7cea1d8e47924863f33c1092f1cbb08f9cfc828b18efd7e005c6d708"
Oct 30 20:56:57.982548 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:56:57.982520    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4a3390f7cea1d8e47924863f33c1092f1cbb08f9cfc828b18efd7e005c6d708\": container with ID starting with e4a3390f7cea1d8e47924863f33c1092f1cbb08f9cfc828b18efd7e005c6d708 not found: ID does not exist" containerID="e4a3390f7cea1d8e47924863f33c1092f1cbb08f9cfc828b18efd7e005c6d708"
Oct 30 20:56:57.982651 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:57.982558    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4a3390f7cea1d8e47924863f33c1092f1cbb08f9cfc828b18efd7e005c6d708"} err="failed to get container status \"e4a3390f7cea1d8e47924863f33c1092f1cbb08f9cfc828b18efd7e005c6d708\": rpc error: code = NotFound desc = could not find container \"e4a3390f7cea1d8e47924863f33c1092f1cbb08f9cfc828b18efd7e005c6d708\": container with ID starting with e4a3390f7cea1d8e47924863f33c1092f1cbb08f9cfc828b18efd7e005c6d708 not found: ID does not exist"
Oct 30 20:56:57.993284 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:57.993234    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"]
Oct 30 20:56:57.998015 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:57.997975    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-66dd76bf94-7p9l7"]
Oct 30 20:56:58.293704 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:58.293604    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="804fadee-a136-472e-b6c6-c1bf4049a6cd" path="/var/lib/kubelet/pods/804fadee-a136-472e-b6c6-c1bf4049a6cd/volumes"
Oct 30 20:56:58.626875 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:58.626829    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:56:59.121009 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:56:59.120971    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:00.724187 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:00.724148    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:00.931415 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:00.931343    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:02.301415 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:02.301374    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:02.659026 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:02.658986    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:23.929810 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:57:23.929770    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:57:24.729957 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:24.729918    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:24.952069 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:24.952033    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:25.057423 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.057325    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"]
Oct 30 20:57:25.057849 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.057833    4948 cpu_manager.go:414] "containerMap: removing container" podUID="804fadee-a136-472e-b6c6-c1bf4049a6cd" containerName="manager"
Oct 30 20:57:25.057909 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.057851    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="804fadee-a136-472e-b6c6-c1bf4049a6cd" containerName="manager"
Oct 30 20:57:25.057950 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.057936    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="804fadee-a136-472e-b6c6-c1bf4049a6cd" containerName="manager"
Oct 30 20:57:25.062443 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.062416    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.073596 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.073568    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-5a8f94-openshift-default-dockercfg-vl5jm\""
Oct 30 20:57:25.084023 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.083988    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"]
Oct 30 20:57:25.175625 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.175588    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"]
Oct 30 20:57:25.179154 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.179129    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.185858 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.185809    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-4a0c5b-openshift-default-dockercfg-ngx6w\""
Oct 30 20:57:25.198347 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.198311    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"]
Oct 30 20:57:25.206838 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.206801    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.207036 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.206850    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a33086b6-3909-4317-ab87-877c36019f4e-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.207036 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.206890    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.207151 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.207045    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a33086b6-3909-4317-ab87-877c36019f4e-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.207151 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.207074    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.207151 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.207091    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.207475 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.207450    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.207566 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.207490    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx7g2\" (UniqueName: \"kubernetes.io/projected/a33086b6-3909-4317-ab87-877c36019f4e-kube-api-access-gx7g2\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.207566 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.207519    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a33086b6-3909-4317-ab87-877c36019f4e-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.222206 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.222161    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:25.308487 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.308399    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.308487 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.308440    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx7g2\" (UniqueName: \"kubernetes.io/projected/a33086b6-3909-4317-ab87-877c36019f4e-kube-api-access-gx7g2\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.308487 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.308468    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.308487 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.308487    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.308837 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.308521    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a33086b6-3909-4317-ab87-877c36019f4e-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.308837 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.308554    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.308837 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.308787    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a33086b6-3909-4317-ab87-877c36019f4e-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.309071 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.308840    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.309071 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.309003    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.309071 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.309042    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.309071 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.309068    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.309264 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.309096    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.309264 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.309126    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.309264 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.309157    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.309264 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.309200    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a33086b6-3909-4317-ab87-877c36019f4e-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.309264 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.309244    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sgwd\" (UniqueName: \"kubernetes.io/projected/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-kube-api-access-2sgwd\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.309520 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.309325    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.309520 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.309431    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.309626 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.309559    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.309696 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.309674    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a33086b6-3909-4317-ab87-877c36019f4e-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.309795 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.309774    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.309886 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.309853    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.309992 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.309936    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.311580 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.311557    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.311855 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.311836    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a33086b6-3909-4317-ab87-877c36019f4e-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.326941 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.326901    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx7g2\" (UniqueName: \"kubernetes.io/projected/a33086b6-3909-4317-ab87-877c36019f4e-kube-api-access-gx7g2\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.327792 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.327764    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a33086b6-3909-4317-ab87-877c36019f4e-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.378877 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.378830    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:25.411395 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.411335    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.411597 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.411400    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.411597 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.411471    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.411597 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.411511    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.411597 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.411535    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.411597 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.411560    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.411597 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.411586    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.411929 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.411832    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.411929 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.411838    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.412058 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.411926    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sgwd\" (UniqueName: \"kubernetes.io/projected/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-kube-api-access-2sgwd\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.412386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.412339    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.412498 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.412485    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.413125 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.412891    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.413125 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.413008    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.414722 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.414699    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.415194 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.415176    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.442576 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.442547    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.444409 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.443448    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sgwd\" (UniqueName: \"kubernetes.io/projected/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-kube-api-access-2sgwd\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.494107 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.494060    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:25.510591 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.510551    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"]
Oct 30 20:57:25.517980 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.517940    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.524444 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.524413    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-39fb96-openshift-default-dockercfg-t7kpm\""
Oct 30 20:57:25.542816 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.539952    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"]
Oct 30 20:57:25.547939 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.547879    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:25.613298 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.613249    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31514f00-a0a8-4892-a89d-504474b598be-istio-token\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.613544 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.613374    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb8g9\" (UniqueName: \"kubernetes.io/projected/31514f00-a0a8-4892-a89d-504474b598be-kube-api-access-qb8g9\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.613544 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.613453    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-workload-certs\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.613641 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.613547    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-istio-data\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.613641 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.613623    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-istio-envoy\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.613728 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.613709    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31514f00-a0a8-4892-a89d-504474b598be-istio-podinfo\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.613771 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.613740    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-credential-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.613826 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.613775    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31514f00-a0a8-4892-a89d-504474b598be-istiod-ca-cert\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.613915 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.613898    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-workload-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.654382 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.654323    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"]
Oct 30 20:57:25.658006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.657984    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.666338 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.666299    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-c4b379-openshift-default-dockercfg-wchc9\""
Oct 30 20:57:25.674959 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.674923    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"]
Oct 30 20:57:25.678302 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.678259    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"]
Oct 30 20:57:25.679834 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:57:25.679803    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda33086b6_3909_4317_ab87_877c36019f4e.slice/crio-9050fead7ee6ffa6b7c737c78141db2cf8451b1f0d81a86d60e5b76132047012 WatchSource:0}: Error finding container 9050fead7ee6ffa6b7c737c78141db2cf8451b1f0d81a86d60e5b76132047012: Status 404 returned error can't find the container with id 9050fead7ee6ffa6b7c737c78141db2cf8451b1f0d81a86d60e5b76132047012
Oct 30 20:57:25.682950 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.682875    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:25.683070 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.683032    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:25.683145 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.683115    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.715203    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-workload-certs\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.715292    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wz29\" (UniqueName: \"kubernetes.io/projected/37aaeb67-eddf-4e41-8980-e44ed94a18eb-kube-api-access-7wz29\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.715399    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.715449    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.715479    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-istio-data\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.715511    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-istio-envoy\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.715732    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-workload-certs\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.715807    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.715854    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-istio-data\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.715935    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31514f00-a0a8-4892-a89d-504474b598be-istio-podinfo\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.715966    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.715992    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.716022    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-credential-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.716050    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.716085    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31514f00-a0a8-4892-a89d-504474b598be-istiod-ca-cert\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.716158    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-workload-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.716189    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31514f00-a0a8-4892-a89d-504474b598be-istio-token\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.716221    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.716255    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb8g9\" (UniqueName: \"kubernetes.io/projected/31514f00-a0a8-4892-a89d-504474b598be-kube-api-access-qb8g9\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.716286    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.716780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.716775    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-workload-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.717693 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.717043    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-credential-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.717693 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.717313    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31514f00-a0a8-4892-a89d-504474b598be-istiod-ca-cert\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.718896 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.718850    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-istio-envoy\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.719930 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.719901    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31514f00-a0a8-4892-a89d-504474b598be-istio-podinfo\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.743881 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.743838    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb8g9\" (UniqueName: \"kubernetes.io/projected/31514f00-a0a8-4892-a89d-504474b598be-kube-api-access-qb8g9\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.745747 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.745717    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31514f00-a0a8-4892-a89d-504474b598be-istio-token\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.803267 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.802942    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"]
Oct 30 20:57:25.807746 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.807709    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:25.814908 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.814861    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:25.815033 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.814967    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:25.815033 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.815012    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:25.817148 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.817114    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.817278 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.817172    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.817278 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.817212    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wz29\" (UniqueName: \"kubernetes.io/projected/37aaeb67-eddf-4e41-8980-e44ed94a18eb-kube-api-access-7wz29\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.817448 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.817274    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.817448 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.817320    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.817448 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.817374    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.817621 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.817446    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.817621 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.817475    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.817621 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.817507    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.818212 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.818185    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.822450 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.822341    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.822450 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.822415    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.822651 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.822547    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.822716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.822651    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.822716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.822655    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.823855 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.823826    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.835732 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.835704    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.836345 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.836321    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wz29\" (UniqueName: \"kubernetes.io/projected/37aaeb67-eddf-4e41-8980-e44ed94a18eb-kube-api-access-7wz29\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:25.841757 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.841492    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:25.985887 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:25.985843    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:26.024854 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.024807    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:26.113112 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.113067    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw" event={"ID":"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450","Type":"ContainerStarted","Data":"3b9f037d5fabdb03a2e6ccb64861c9a9be06de2b0690bbacf7bc89af308db6fd"}
Oct 30 20:57:26.113323 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.113171    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw" event={"ID":"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450","Type":"ContainerStarted","Data":"d5ca9569d1e76629ea56d375bad10f8aef1ccbcb5006123ccbf90effef91cf5b"}
Oct 30 20:57:26.115631 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.115587    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z" event={"ID":"a33086b6-3909-4317-ab87-877c36019f4e","Type":"ContainerStarted","Data":"1cd116f9569a4274caa8f8a583d67eed840de85f831dd84bd3dfb5f16cefa2d0"}
Oct 30 20:57:26.115810 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.115657    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z" event={"ID":"a33086b6-3909-4317-ab87-877c36019f4e","Type":"ContainerStarted","Data":"9050fead7ee6ffa6b7c737c78141db2cf8451b1f0d81a86d60e5b76132047012"}
Oct 30 20:57:26.145914 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.145239    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw" podStartSLOduration=1.145218981 podStartE2EDuration="1.145218981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:26.143396018 +0000 UTC m=+1113.962908006" watchObservedRunningTime="2026-10-30 20:57:26.145218981 +0000 UTC m=+1113.964730968"
Oct 30 20:57:26.170106 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.170043    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z" podStartSLOduration=1.1700257139999999 podStartE2EDuration="1.170025714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:26.169218494 +0000 UTC m=+1113.988730498" watchObservedRunningTime="2026-10-30 20:57:26.170025714 +0000 UTC m=+1113.989537702"
Oct 30 20:57:26.187959 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.187921    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"]
Oct 30 20:57:26.189911 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:57:26.189880    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31514f00_a0a8_4892_a89d_504474b598be.slice/crio-2c3c48c62207900641dfb1341b8bf73da3755627cf869438ffd0ed787e45fcf2 WatchSource:0}: Error finding container 2c3c48c62207900641dfb1341b8bf73da3755627cf869438ffd0ed787e45fcf2: Status 404 returned error can't find the container with id 2c3c48c62207900641dfb1341b8bf73da3755627cf869438ffd0ed787e45fcf2
Oct 30 20:57:26.192261 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.192224    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:26.192388 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.192295    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:26.192388 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.192342    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:26.235940 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.235834    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:26.319135 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.319030    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"]
Oct 30 20:57:26.352855 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.352305    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:26.352855 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.352403    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:26.352855 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.352440    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:26.380248 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.380207    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:26.388404 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.387466    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:26.494964 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.494931    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:26.505542 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:26.505506    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:27.122286 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:27.122244    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph" event={"ID":"31514f00-a0a8-4892-a89d-504474b598be","Type":"ContainerStarted","Data":"4e66f4ee8afa86275293eb3f10b9c06fc0e1b5fb919b70de593d93631b15729a"}
Oct 30 20:57:27.122892 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:27.122319    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph" event={"ID":"31514f00-a0a8-4892-a89d-504474b598be","Type":"ContainerStarted","Data":"2c3c48c62207900641dfb1341b8bf73da3755627cf869438ffd0ed787e45fcf2"}
Oct 30 20:57:27.124138 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:27.124103    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf" event={"ID":"37aaeb67-eddf-4e41-8980-e44ed94a18eb","Type":"ContainerStarted","Data":"f46192a4c7fb70ad68fff4efefae56bc8d4c4f0f1637ec7a09f2a111750af108"}
Oct 30 20:57:27.124275 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:27.124168    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf" event={"ID":"37aaeb67-eddf-4e41-8980-e44ed94a18eb","Type":"ContainerStarted","Data":"aa3ae6e56e017b107ba9352c158aacd7c04a1e1483071bb0b51d6960ba107044"}
Oct 30 20:57:27.124355 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:27.124339    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:27.124818 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:27.124655    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:27.125686 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:27.125663    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:27.125831 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:27.125724    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:27.210635 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:27.210569    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph" podStartSLOduration=2.21055013 podStartE2EDuration="2.21055013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:27.207171627 +0000 UTC m=+1115.026683618" watchObservedRunningTime="2026-10-30 20:57:27.21055013 +0000 UTC m=+1115.030062220"
Oct 30 20:57:27.322628 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:27.322570    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf" podStartSLOduration=2.322551709 podStartE2EDuration="2.322551709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:27.320905201 +0000 UTC m=+1115.140417192" watchObservedRunningTime="2026-10-30 20:57:27.322551709 +0000 UTC m=+1115.142063697"
Oct 30 20:57:27.842392 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:27.842341    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:27.848419 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:27.848387    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:27.987165 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:27.987127    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:27.995031 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:27.994990    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:28.130409 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:28.130282    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:28.130409 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:28.130344    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:28.131109 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:28.131078    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:28.131241 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:28.131151    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:28.692767 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:28.692722    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:28.933990 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:28.933954    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:29.147276 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:29.147237    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:29.648098 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:29.648061    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:29.867374 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:29.867332    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:30.082139 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.082102    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"]
Oct 30 20:57:30.086611 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.086582    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"
Oct 30 20:57:30.093430 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.093401    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-4a0c5b\""
Oct 30 20:57:30.100043 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.099750    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"]
Oct 30 20:57:30.143081 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.143028    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:30.154768 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.154731    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"]
Oct 30 20:57:30.159082 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.159050    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"
Oct 30 20:57:30.176016 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.175983    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"]
Oct 30 20:57:30.176970 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.176946    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-4a0c5b-dockercfg-7sz45\""
Oct 30 20:57:30.177449 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.177427    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx6ct\" (UniqueName: \"kubernetes.io/projected/c7a5ee70-6beb-43bf-813e-d45272a970e6-kube-api-access-jx6ct\") pod \"payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55\" (UID: \"c7a5ee70-6beb-43bf-813e-d45272a970e6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"
Oct 30 20:57:30.177554 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.177531    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7a5ee70-6beb-43bf-813e-d45272a970e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55\" (UID: \"c7a5ee70-6beb-43bf-813e-d45272a970e6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"
Oct 30 20:57:30.279038 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.278991    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7a5ee70-6beb-43bf-813e-d45272a970e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55\" (UID: \"c7a5ee70-6beb-43bf-813e-d45272a970e6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"
Oct 30 20:57:30.279281 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.279242    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4420d1a-5925-4097-8f45-a84c866412e4-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx\" (UID: \"a4420d1a-5925-4097-8f45-a84c866412e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"
Oct 30 20:57:30.279466 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.279435    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7kql\" (UniqueName: \"kubernetes.io/projected/a4420d1a-5925-4097-8f45-a84c866412e4-kube-api-access-g7kql\") pod \"payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx\" (UID: \"a4420d1a-5925-4097-8f45-a84c866412e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"
Oct 30 20:57:30.280039 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.280013    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7a5ee70-6beb-43bf-813e-d45272a970e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55\" (UID: \"c7a5ee70-6beb-43bf-813e-d45272a970e6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"
Oct 30 20:57:30.280039 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.280026    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx6ct\" (UniqueName: \"kubernetes.io/projected/c7a5ee70-6beb-43bf-813e-d45272a970e6-kube-api-access-jx6ct\") pod \"payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55\" (UID: \"c7a5ee70-6beb-43bf-813e-d45272a970e6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"
Oct 30 20:57:30.321533 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.321501    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx6ct\" (UniqueName: \"kubernetes.io/projected/c7a5ee70-6beb-43bf-813e-d45272a970e6-kube-api-access-jx6ct\") pod \"payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55\" (UID: \"c7a5ee70-6beb-43bf-813e-d45272a970e6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"
Oct 30 20:57:30.391428 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.391263    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4420d1a-5925-4097-8f45-a84c866412e4-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx\" (UID: \"a4420d1a-5925-4097-8f45-a84c866412e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"
Oct 30 20:57:30.391428 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.391329    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7kql\" (UniqueName: \"kubernetes.io/projected/a4420d1a-5925-4097-8f45-a84c866412e4-kube-api-access-g7kql\") pod \"payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx\" (UID: \"a4420d1a-5925-4097-8f45-a84c866412e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"
Oct 30 20:57:30.392855 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.392822    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4420d1a-5925-4097-8f45-a84c866412e4-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx\" (UID: \"a4420d1a-5925-4097-8f45-a84c866412e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"
Oct 30 20:57:30.401646 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.401587    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"
Oct 30 20:57:30.438249 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.438216    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:30.440271 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.440225    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7kql\" (UniqueName: \"kubernetes.io/projected/a4420d1a-5925-4097-8f45-a84c866412e4-kube-api-access-g7kql\") pod \"payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx\" (UID: \"a4420d1a-5925-4097-8f45-a84c866412e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"
Oct 30 20:57:30.473930 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.473888    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"
Oct 30 20:57:30.714908 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.714810    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:30.727784 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.727751    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"]
Oct 30 20:57:30.729620 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:57:30.729584    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a5ee70_6beb_43bf_813e_d45272a970e6.slice/crio-18d5ca3463334ddfa2cc216ab1082063ff68b1f490ebba4c75cfce78a67976d8 WatchSource:0}: Error finding container 18d5ca3463334ddfa2cc216ab1082063ff68b1f490ebba4c75cfce78a67976d8: Status 404 returned error can't find the container with id 18d5ca3463334ddfa2cc216ab1082063ff68b1f490ebba4c75cfce78a67976d8
Oct 30 20:57:30.776496 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:30.776467    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"]
Oct 30 20:57:30.782618 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:57:30.782589    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4420d1a_5925_4097_8f45_a84c866412e4.slice/crio-038d8b1957fee76649b681d714d299e0d17f8b0ff11b9a278d7aa7abf860dd1c WatchSource:0}: Error finding container 038d8b1957fee76649b681d714d299e0d17f8b0ff11b9a278d7aa7abf860dd1c: Status 404 returned error can't find the container with id 038d8b1957fee76649b681d714d299e0d17f8b0ff11b9a278d7aa7abf860dd1c
Oct 30 20:57:31.003778 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.003678    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:31.150504 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.150461    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx" event={"ID":"a4420d1a-5925-4097-8f45-a84c866412e4","Type":"ContainerStarted","Data":"2eb8e1e7732ebf178a5179340b7805fcecfc0c627e1a79d01291e436d5b47583"}
Oct 30 20:57:31.150742 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.150538    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx" event={"ID":"a4420d1a-5925-4097-8f45-a84c866412e4","Type":"ContainerStarted","Data":"038d8b1957fee76649b681d714d299e0d17f8b0ff11b9a278d7aa7abf860dd1c"}
Oct 30 20:57:31.150742 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.150727    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"
Oct 30 20:57:31.152219 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.152190    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55" event={"ID":"c7a5ee70-6beb-43bf-813e-d45272a970e6","Type":"ContainerStarted","Data":"38c3e94ea25a80e9fdec34c116af187cf06e87f26dacaf3ae56f5d4f6cec81f0"}
Oct 30 20:57:31.152328 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.152241    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55" event={"ID":"c7a5ee70-6beb-43bf-813e-d45272a970e6","Type":"ContainerStarted","Data":"18d5ca3463334ddfa2cc216ab1082063ff68b1f490ebba4c75cfce78a67976d8"}
Oct 30 20:57:31.152328 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.152275    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"
Oct 30 20:57:31.172234 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.172168    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx" podStartSLOduration=1.17215082 podStartE2EDuration="1.17215082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:31.171070376 +0000 UTC m=+1118.990582365" watchObservedRunningTime="2026-10-30 20:57:31.17215082 +0000 UTC m=+1118.991662807"
Oct 30 20:57:31.192641 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.192583    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55" podStartSLOduration=1.192568558 podStartE2EDuration="1.192568558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:31.189815466 +0000 UTC m=+1119.009327454" watchObservedRunningTime="2026-10-30 20:57:31.192568558 +0000 UTC m=+1119.012080546"
Oct 30 20:57:31.227081 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.226985    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:31.447844 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.447806    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"]
Oct 30 20:57:31.451843 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.451817    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"
Oct 30 20:57:31.458761 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.458732    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-32a969\""
Oct 30 20:57:31.459238 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.458970    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-32a969-dockercfg-glvsf\""
Oct 30 20:57:31.462556 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.462518    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"]
Oct 30 20:57:31.509234 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.509192    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"]
Oct 30 20:57:31.513862 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.513827    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"
Oct 30 20:57:31.531499 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.531452    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:31.533053 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.533017    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"]
Oct 30 20:57:31.612599 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.612552    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f33af97-c07d-41b5-a777-dc5b93aabfcf-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs\" (UID: \"8f33af97-c07d-41b5-a777-dc5b93aabfcf\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"
Oct 30 20:57:31.612800 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.612622    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f9dbca-3c12-4f9e-81cc-35240b0a3210-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp\" (UID: \"c8f9dbca-3c12-4f9e-81cc-35240b0a3210\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"
Oct 30 20:57:31.612800 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.612745    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq2jb\" (UniqueName: \"kubernetes.io/projected/8f33af97-c07d-41b5-a777-dc5b93aabfcf-kube-api-access-lq2jb\") pod \"payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs\" (UID: \"8f33af97-c07d-41b5-a777-dc5b93aabfcf\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"
Oct 30 20:57:31.612952 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.612878    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzhhw\" (UniqueName: \"kubernetes.io/projected/c8f9dbca-3c12-4f9e-81cc-35240b0a3210-kube-api-access-jzhhw\") pod \"payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp\" (UID: \"c8f9dbca-3c12-4f9e-81cc-35240b0a3210\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"
Oct 30 20:57:31.714264 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.714159    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzhhw\" (UniqueName: \"kubernetes.io/projected/c8f9dbca-3c12-4f9e-81cc-35240b0a3210-kube-api-access-jzhhw\") pod \"payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp\" (UID: \"c8f9dbca-3c12-4f9e-81cc-35240b0a3210\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"
Oct 30 20:57:31.714578 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.714557    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f33af97-c07d-41b5-a777-dc5b93aabfcf-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs\" (UID: \"8f33af97-c07d-41b5-a777-dc5b93aabfcf\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"
Oct 30 20:57:31.714742 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.714728    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f9dbca-3c12-4f9e-81cc-35240b0a3210-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp\" (UID: \"c8f9dbca-3c12-4f9e-81cc-35240b0a3210\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"
Oct 30 20:57:31.714922 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.714908    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq2jb\" (UniqueName: \"kubernetes.io/projected/8f33af97-c07d-41b5-a777-dc5b93aabfcf-kube-api-access-lq2jb\") pod \"payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs\" (UID: \"8f33af97-c07d-41b5-a777-dc5b93aabfcf\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"
Oct 30 20:57:31.716699 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.716671    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f33af97-c07d-41b5-a777-dc5b93aabfcf-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs\" (UID: \"8f33af97-c07d-41b5-a777-dc5b93aabfcf\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"
Oct 30 20:57:31.723162 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.717747    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f9dbca-3c12-4f9e-81cc-35240b0a3210-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp\" (UID: \"c8f9dbca-3c12-4f9e-81cc-35240b0a3210\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"
Oct 30 20:57:31.729161 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.729129    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzhhw\" (UniqueName: \"kubernetes.io/projected/c8f9dbca-3c12-4f9e-81cc-35240b0a3210-kube-api-access-jzhhw\") pod \"payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp\" (UID: \"c8f9dbca-3c12-4f9e-81cc-35240b0a3210\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"
Oct 30 20:57:31.729875 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.729848    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq2jb\" (UniqueName: \"kubernetes.io/projected/8f33af97-c07d-41b5-a777-dc5b93aabfcf-kube-api-access-lq2jb\") pod \"payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs\" (UID: \"8f33af97-c07d-41b5-a777-dc5b93aabfcf\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"
Oct 30 20:57:31.761289 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.761247    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:31.769189 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.769154    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"
Oct 30 20:57:31.828670 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:31.828630    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"
Oct 30 20:57:32.052946 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.052847    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"]
Oct 30 20:57:32.058253 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.058226    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"
Oct 30 20:57:32.063237 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.063201    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w5-65968b\""
Oct 30 20:57:32.067306 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.067200    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w5-65968b-dockercfg-mqvkk\""
Oct 30 20:57:32.075872 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.075831    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"]
Oct 30 20:57:32.085716 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.085670    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"]
Oct 30 20:57:32.091290 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.091262    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"
Oct 30 20:57:32.113433 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.113393    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:32.114955 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.114850    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"]
Oct 30 20:57:32.118439 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.118408    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"]
Oct 30 20:57:32.136200 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.136166    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"]
Oct 30 20:57:32.213989 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.213827    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp" event={"ID":"c8f9dbca-3c12-4f9e-81cc-35240b0a3210","Type":"ContainerStarted","Data":"32acf5e885d83ce7172fa16540d42061e0ec7c61bda21efeca99a837bbe9a69a"}
Oct 30 20:57:32.219017 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.218963    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs" event={"ID":"8f33af97-c07d-41b5-a777-dc5b93aabfcf","Type":"ContainerStarted","Data":"21fc741cde5b177f545e1395fe3b03b1b05f601a9c5f6e43ff9d0f83c57d89b5"}
Oct 30 20:57:32.220458 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.220426    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a314402-a3a6-42d4-a9d3-526b464bea78-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws\" (UID: \"1a314402-a3a6-42d4-a9d3-526b464bea78\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"
Oct 30 20:57:32.220643 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.220479    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv9fx\" (UniqueName: \"kubernetes.io/projected/2a8540f7-c0cd-4778-a5aa-9665ddd8f820-kube-api-access-gv9fx\") pod \"payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246\" (UID: \"2a8540f7-c0cd-4778-a5aa-9665ddd8f820\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"
Oct 30 20:57:32.220643 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.220533    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a8540f7-c0cd-4778-a5aa-9665ddd8f820-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246\" (UID: \"2a8540f7-c0cd-4778-a5aa-9665ddd8f820\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"
Oct 30 20:57:32.220643 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.220591    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzdp4\" (UniqueName: \"kubernetes.io/projected/1a314402-a3a6-42d4-a9d3-526b464bea78-kube-api-access-dzdp4\") pod \"payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws\" (UID: \"1a314402-a3a6-42d4-a9d3-526b464bea78\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"
Oct 30 20:57:32.305123 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.304831    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"]
Oct 30 20:57:32.309584 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.309551    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 20:57:32.324902 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.324866    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"]
Oct 30 20:57:32.325127 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.325100    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-4a0c5b-serving-cert\""
Oct 30 20:57:32.327669 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.327633    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc19cb54-92ef-4371-a1d1-2107238ea15d-metrics-certs\") pod \"maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt\" (UID: \"cc19cb54-92ef-4371-a1d1-2107238ea15d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 20:57:32.327862 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.327686    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a8540f7-c0cd-4778-a5aa-9665ddd8f820-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246\" (UID: \"2a8540f7-c0cd-4778-a5aa-9665ddd8f820\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"
Oct 30 20:57:32.327862 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.327765    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc19cb54-92ef-4371-a1d1-2107238ea15d-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt\" (UID: \"cc19cb54-92ef-4371-a1d1-2107238ea15d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 20:57:32.327862 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.327803    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzdp4\" (UniqueName: \"kubernetes.io/projected/1a314402-a3a6-42d4-a9d3-526b464bea78-kube-api-access-dzdp4\") pod \"payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws\" (UID: \"1a314402-a3a6-42d4-a9d3-526b464bea78\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"
Oct 30 20:57:32.327862 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.327825    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvlhl\" (UniqueName: \"kubernetes.io/projected/cc19cb54-92ef-4371-a1d1-2107238ea15d-kube-api-access-jvlhl\") pod \"maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt\" (UID: \"cc19cb54-92ef-4371-a1d1-2107238ea15d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 20:57:32.328120 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.327977    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc19cb54-92ef-4371-a1d1-2107238ea15d-maas-api-tls\") pod \"maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt\" (UID: \"cc19cb54-92ef-4371-a1d1-2107238ea15d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 20:57:32.328120 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.328015    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a314402-a3a6-42d4-a9d3-526b464bea78-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws\" (UID: \"1a314402-a3a6-42d4-a9d3-526b464bea78\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"
Oct 30 20:57:32.328120 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.328052    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv9fx\" (UniqueName: \"kubernetes.io/projected/2a8540f7-c0cd-4778-a5aa-9665ddd8f820-kube-api-access-gv9fx\") pod \"payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246\" (UID: \"2a8540f7-c0cd-4778-a5aa-9665ddd8f820\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"
Oct 30 20:57:32.330496 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.330462    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a314402-a3a6-42d4-a9d3-526b464bea78-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws\" (UID: \"1a314402-a3a6-42d4-a9d3-526b464bea78\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"
Oct 30 20:57:32.331602 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.331577    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a8540f7-c0cd-4778-a5aa-9665ddd8f820-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246\" (UID: \"2a8540f7-c0cd-4778-a5aa-9665ddd8f820\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"
Oct 30 20:57:32.341903 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.341864    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:32.344203 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.344176    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv9fx\" (UniqueName: \"kubernetes.io/projected/2a8540f7-c0cd-4778-a5aa-9665ddd8f820-kube-api-access-gv9fx\") pod \"payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246\" (UID: \"2a8540f7-c0cd-4778-a5aa-9665ddd8f820\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"
Oct 30 20:57:32.347584 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.347552    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzdp4\" (UniqueName: \"kubernetes.io/projected/1a314402-a3a6-42d4-a9d3-526b464bea78-kube-api-access-dzdp4\") pod \"payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws\" (UID: \"1a314402-a3a6-42d4-a9d3-526b464bea78\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"
Oct 30 20:57:32.376120 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.376081    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"
Oct 30 20:57:32.432090 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.431182    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc19cb54-92ef-4371-a1d1-2107238ea15d-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt\" (UID: \"cc19cb54-92ef-4371-a1d1-2107238ea15d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 20:57:32.432090 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.431266    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvlhl\" (UniqueName: \"kubernetes.io/projected/cc19cb54-92ef-4371-a1d1-2107238ea15d-kube-api-access-jvlhl\") pod \"maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt\" (UID: \"cc19cb54-92ef-4371-a1d1-2107238ea15d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 20:57:32.432090 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.431421    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc19cb54-92ef-4371-a1d1-2107238ea15d-maas-api-tls\") pod \"maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt\" (UID: \"cc19cb54-92ef-4371-a1d1-2107238ea15d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 20:57:32.432090 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.431491    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc19cb54-92ef-4371-a1d1-2107238ea15d-metrics-certs\") pod \"maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt\" (UID: \"cc19cb54-92ef-4371-a1d1-2107238ea15d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 20:57:32.433794 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.433444    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc19cb54-92ef-4371-a1d1-2107238ea15d-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt\" (UID: \"cc19cb54-92ef-4371-a1d1-2107238ea15d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 20:57:32.433794 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.433666    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"
Oct 30 20:57:32.452966 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.450847    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc19cb54-92ef-4371-a1d1-2107238ea15d-maas-api-tls\") pod \"maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt\" (UID: \"cc19cb54-92ef-4371-a1d1-2107238ea15d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 20:57:32.452966 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.452180    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc19cb54-92ef-4371-a1d1-2107238ea15d-metrics-certs\") pod \"maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt\" (UID: \"cc19cb54-92ef-4371-a1d1-2107238ea15d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 20:57:32.465089 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.465064    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvlhl\" (UniqueName: \"kubernetes.io/projected/cc19cb54-92ef-4371-a1d1-2107238ea15d-kube-api-access-jvlhl\") pod \"maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt\" (UID: \"cc19cb54-92ef-4371-a1d1-2107238ea15d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 20:57:32.589350 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.589304    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:32.629765 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.629718    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 20:57:32.704544 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.703168    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"]
Oct 30 20:57:32.812428 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.772549    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"]
Oct 30 20:57:32.826826 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.823816    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:32.992697 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:32.992629    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"]
Oct 30 20:57:32.998163 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:57:32.998126    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc19cb54_92ef_4371_a1d1_2107238ea15d.slice/crio-6aef979f925285e3c826e958b4f1417360b5baf540af1988fd973fc1e4cf33c4 WatchSource:0}: Error finding container 6aef979f925285e3c826e958b4f1417360b5baf540af1988fd973fc1e4cf33c4: Status 404 returned error can't find the container with id 6aef979f925285e3c826e958b4f1417360b5baf540af1988fd973fc1e4cf33c4
Oct 30 20:57:33.224930 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.224830    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt" event={"ID":"cc19cb54-92ef-4371-a1d1-2107238ea15d","Type":"ContainerStarted","Data":"6aef979f925285e3c826e958b4f1417360b5baf540af1988fd973fc1e4cf33c4"}
Oct 30 20:57:33.226927 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.226895    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp" event={"ID":"c8f9dbca-3c12-4f9e-81cc-35240b0a3210","Type":"ContainerStarted","Data":"8551c7646566e10e3ebce440b7fc4998d7bfbd2753e2045ebe25dd8dbbb3ab19"}
Oct 30 20:57:33.227128 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.227082    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"
Oct 30 20:57:33.228738 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.228706    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246" event={"ID":"2a8540f7-c0cd-4778-a5aa-9665ddd8f820","Type":"ContainerStarted","Data":"740a14ce9384f02a9bffe55fe8e081d22b3f28f9077397cbf1a7b202b9c9f67f"}
Oct 30 20:57:33.228892 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.228752    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246" event={"ID":"2a8540f7-c0cd-4778-a5aa-9665ddd8f820","Type":"ContainerStarted","Data":"6ad50bfe9e90e1e3ce5626ebf4e4f2aa0da2fd13e6d71da0ea97c168b3b48e64"}
Oct 30 20:57:33.228892 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.228785    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"
Oct 30 20:57:33.230488 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.230464    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws" event={"ID":"1a314402-a3a6-42d4-a9d3-526b464bea78","Type":"ContainerStarted","Data":"d51ab0dbdf5adc17ee899da889681a97e5ecb10ce6325735567acd850a56b9a4"}
Oct 30 20:57:33.230609 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.230513    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"
Oct 30 20:57:33.230609 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.230534    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws" event={"ID":"1a314402-a3a6-42d4-a9d3-526b464bea78","Type":"ContainerStarted","Data":"98ab9658ed583f2b05744b6fa71515a0ebb8802f20ba549011e37733136a7c31"}
Oct 30 20:57:33.232127 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.232104    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs" event={"ID":"8f33af97-c07d-41b5-a777-dc5b93aabfcf","Type":"ContainerStarted","Data":"8758f978e653651f1bdb6987637ea8aabcd30ab7501b85ff964af2d14e25d693"}
Oct 30 20:57:33.232242 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.232190    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"
Oct 30 20:57:33.262951 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.262893    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp" podStartSLOduration=2.262871485 podStartE2EDuration="2.262871485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:33.259261689 +0000 UTC m=+1121.078773677" watchObservedRunningTime="2026-10-30 20:57:33.262871485 +0000 UTC m=+1121.082383472"
Oct 30 20:57:33.302985 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.302947    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:33.303369 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.303305    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws" podStartSLOduration=1.303291921 podStartE2EDuration="1.303291921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:33.301802636 +0000 UTC m=+1121.121314625" watchObservedRunningTime="2026-10-30 20:57:33.303291921 +0000 UTC m=+1121.122803910"
Oct 30 20:57:33.323684 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.323625    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs" podStartSLOduration=2.323608783 podStartE2EDuration="2.323608783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:33.32130964 +0000 UTC m=+1121.140821630" watchObservedRunningTime="2026-10-30 20:57:33.323608783 +0000 UTC m=+1121.143120773"
Oct 30 20:57:33.358759 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.358690    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246" podStartSLOduration=1.358668885 podStartE2EDuration="1.358668885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:33.358274294 +0000 UTC m=+1121.177786284" watchObservedRunningTime="2026-10-30 20:57:33.358668885 +0000 UTC m=+1121.178180874"
Oct 30 20:57:33.534285 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.534069    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:33.890263 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.890227    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"]
Oct 30 20:57:33.894839 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.894810    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 20:57:33.903294 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.903260    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:33.914048 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.914012    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-c4b379-serving-cert\""
Oct 30 20:57:33.916237 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.916199    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"]
Oct 30 20:57:33.958429 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.958389    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k2zf\" (UniqueName: \"kubernetes.io/projected/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-kube-api-access-6k2zf\") pod \"maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd\" (UID: \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 20:57:33.958614 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.958525    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-maas-api-tls\") pod \"maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd\" (UID: \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 20:57:33.958614 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.958554    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd\" (UID: \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 20:57:33.958783 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:33.958753    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-metrics-certs\") pod \"maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd\" (UID: \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 20:57:34.079817 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.079733    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-metrics-certs\") pod \"maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd\" (UID: \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 20:57:34.080233 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.080209    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k2zf\" (UniqueName: \"kubernetes.io/projected/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-kube-api-access-6k2zf\") pod \"maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd\" (UID: \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 20:57:34.080469 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.080451    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-maas-api-tls\") pod \"maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd\" (UID: \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 20:57:34.080616 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.080600    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd\" (UID: \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 20:57:34.081982 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.081959    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd\" (UID: \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 20:57:34.111706 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.111669    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k2zf\" (UniqueName: \"kubernetes.io/projected/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-kube-api-access-6k2zf\") pod \"maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd\" (UID: \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 20:57:34.124562 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.122486    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:34.124562 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.123603    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-metrics-certs\") pod \"maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd\" (UID: \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 20:57:34.144268 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.144162    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-maas-api-tls\") pod \"maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd\" (UID: \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 20:57:34.216464 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.216409    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 20:57:34.244590 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.243829    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt" event={"ID":"cc19cb54-92ef-4371-a1d1-2107238ea15d","Type":"ContainerStarted","Data":"65d3a72924910c133438f7a6270081d810e19553764aa9085bbbfd5e168b198e"}
Oct 30 20:57:34.244590 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.244251    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 20:57:34.265059 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.264994    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt" podStartSLOduration=1.8011246810000001 podStartE2EDuration="2.26497694s" totalImagesPullingTime="463.852259ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:34.264317545 +0000 UTC m=+1122.083829559" watchObservedRunningTime="2026-10-30 20:57:34.26497694 +0000 UTC m=+1122.084488928"
Oct 30 20:57:34.324043 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.323998    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:34.502573 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.502541    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"]
Oct 30 20:57:34.504276 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:57:34.504244    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded0564b2_afd2_4b28_8a99_a0ae8f46b516.slice/crio-811be35a67adc11d4d7997b647259f3709074427c472a2c03f6948c2eb8d21d0 WatchSource:0}: Error finding container 811be35a67adc11d4d7997b647259f3709074427c472a2c03f6948c2eb8d21d0: Status 404 returned error can't find the container with id 811be35a67adc11d4d7997b647259f3709074427c472a2c03f6948c2eb8d21d0
Oct 30 20:57:34.928427 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.927158    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"]
Oct 30 20:57:34.940021 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.937973    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 20:57:34.943414 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.943166    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"]
Oct 30 20:57:34.954702 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.954665    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-5a8f94-serving-cert\""
Oct 30 20:57:34.991457 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.991421    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-maas-api-tls\") pod \"maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7\" (UID: \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 20:57:34.991691 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.991506    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg4tf\" (UniqueName: \"kubernetes.io/projected/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-kube-api-access-jg4tf\") pod \"maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7\" (UID: \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 20:57:34.991691 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.991615    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-metrics-certs\") pod \"maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7\" (UID: \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 20:57:34.991691 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:34.991673    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7\" (UID: \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 20:57:35.092563 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:35.092526    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-maas-api-tls\") pod \"maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7\" (UID: \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 20:57:35.092795 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:35.092633    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg4tf\" (UniqueName: \"kubernetes.io/projected/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-kube-api-access-jg4tf\") pod \"maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7\" (UID: \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 20:57:35.092795 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:35.092662    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-metrics-certs\") pod \"maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7\" (UID: \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 20:57:35.092795 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:35.092698    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7\" (UID: \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 20:57:35.092994 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:35.092968    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:35.094217 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:35.094189    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7\" (UID: \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 20:57:35.102145 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:35.102103    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-metrics-certs\") pod \"maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7\" (UID: \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 20:57:35.102303 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:35.102103    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-maas-api-tls\") pod \"maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7\" (UID: \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 20:57:35.109049 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:35.109015    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg4tf\" (UniqueName: \"kubernetes.io/projected/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-kube-api-access-jg4tf\") pod \"maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7\" (UID: \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 20:57:35.251184 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:35.251066    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd" event={"ID":"ed0564b2-afd2-4b28-8a99-a0ae8f46b516","Type":"ContainerStarted","Data":"092e0f5f4377222201d73cd6bebd91215e68761957e92e8d306c771e7e5fb07e"}
Oct 30 20:57:35.251742 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:35.251248    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 20:57:35.251742 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:35.251293    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd" event={"ID":"ed0564b2-afd2-4b28-8a99-a0ae8f46b516","Type":"ContainerStarted","Data":"811be35a67adc11d4d7997b647259f3709074427c472a2c03f6948c2eb8d21d0"}
Oct 30 20:57:35.277702 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:35.277639    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd" podStartSLOduration=1.862301778 podStartE2EDuration="2.277624736s" totalImagesPullingTime="415.322958ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:35.276914864 +0000 UTC m=+1123.096426852" watchObservedRunningTime="2026-10-30 20:57:35.277624736 +0000 UTC m=+1123.097136724"
Oct 30 20:57:35.303167 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:35.302828    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 20:57:35.313931 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:35.313868    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:35.603977 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:35.603944    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"]
Oct 30 20:57:35.605726 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:57:35.605693    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8cf36ba_7a1f_47cf_bfa3_a9e68e4b4c32.slice/crio-5be75cdbae0bc66adf88809b34a688c3d6804bdf90881184bb1eb9c0c4d847e5 WatchSource:0}: Error finding container 5be75cdbae0bc66adf88809b34a688c3d6804bdf90881184bb1eb9c0c4d847e5: Status 404 returned error can't find the container with id 5be75cdbae0bc66adf88809b34a688c3d6804bdf90881184bb1eb9c0c4d847e5
Oct 30 20:57:36.259926 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:36.259887    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7" event={"ID":"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32","Type":"ContainerStarted","Data":"c4fe9122710a62c7859fc555d23eb918f452661678e1964b52bb6389664a03c7"}
Oct 30 20:57:36.260417 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:36.259946    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7" event={"ID":"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32","Type":"ContainerStarted","Data":"5be75cdbae0bc66adf88809b34a688c3d6804bdf90881184bb1eb9c0c4d847e5"}
Oct 30 20:57:36.260417 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:36.259975    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 20:57:36.388874 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:36.388799    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7" podStartSLOduration=1.91659619 podStartE2EDuration="2.38878064s" totalImagesPullingTime="472.18445ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:36.387960327 +0000 UTC m=+1124.207472358" watchObservedRunningTime="2026-10-30 20:57:36.38878064 +0000 UTC m=+1124.208292793"
Oct 30 20:57:36.423074 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:36.423028    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:37.632303 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:37.632253    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:37.840599 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:37.840557    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:38.047667 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:38.047626    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:38.971425 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:38.970463    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:39.178152 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:39.178115    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:40.044908 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:40.044876    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:40.262395 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:40.258110    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:40.297449 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:40.286578    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 20:57:41.310196 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:41.310154    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 20:57:41.415934 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:41.415894    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:41.629480 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:41.629440    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:42.230388 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:42.229466    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"
Oct 30 20:57:42.236803 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:42.236445    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"
Oct 30 20:57:42.453388 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:42.449667    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 20:57:42.980487 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:42.973532    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:43.626314 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:43.626280    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:43.827183 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:43.827143    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:44.175556 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:44.175513    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:57:44.175794 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:44.175583    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf" podUID="37aaeb67-eddf-4e41-8980-e44ed94a18eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:57:44.260990 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:44.259667    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"
Oct 30 20:57:44.267388 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:44.264673    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"
Oct 30 20:57:44.268587 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:44.267745    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"
Oct 30 20:57:44.269620 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:44.268900    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"
Oct 30 20:57:44.705259 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:44.705219    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:46.003260 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:46.003090    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:46.328330 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:46.328243    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:47.439124 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:47.439081    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:48.485711 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:48.485642    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:48.723101 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:48.723059    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:48.932869 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:48.932784    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:49.443791 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:49.443739    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:49.545297 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:49.545259    4948 generic.go:356] "Generic (PLEG): container finished" podID="37aaeb67-eddf-4e41-8980-e44ed94a18eb" containerID="f46192a4c7fb70ad68fff4efefae56bc8d4c4f0f1637ec7a09f2a111750af108" exitCode=0
Oct 30 20:57:49.545780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:49.545335    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf" event={"ID":"37aaeb67-eddf-4e41-8980-e44ed94a18eb","Type":"ContainerDied","Data":"f46192a4c7fb70ad68fff4efefae56bc8d4c4f0f1637ec7a09f2a111750af108"}
Oct 30 20:57:49.545911 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:49.545892    4948 scope.go:122] "RemoveContainer" containerID="f46192a4c7fb70ad68fff4efefae56bc8d4c4f0f1637ec7a09f2a111750af108"
Oct 30 20:57:49.547734 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:49.547566    4948 generic.go:356] "Generic (PLEG): container finished" podID="77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" containerID="3b9f037d5fabdb03a2e6ccb64861c9a9be06de2b0690bbacf7bc89af308db6fd" exitCode=0
Oct 30 20:57:49.547734 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:49.547652    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw" event={"ID":"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450","Type":"ContainerDied","Data":"3b9f037d5fabdb03a2e6ccb64861c9a9be06de2b0690bbacf7bc89af308db6fd"}
Oct 30 20:57:49.547921 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:49.547654    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:49.547921 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:49.547808    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:49.547921 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:49.547865    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:49.548079 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:49.548063    4948 scope.go:122] "RemoveContainer" containerID="3b9f037d5fabdb03a2e6ccb64861c9a9be06de2b0690bbacf7bc89af308db6fd"
Oct 30 20:57:49.568787 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:49.550102    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:49.568787 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:49.550185    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:49.568787 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:49.550235    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:49.736018 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:49.735888    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:50.128045 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:50.128008    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:50.439445 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:50.439295    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:50.585318 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:50.585265    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf" event={"ID":"37aaeb67-eddf-4e41-8980-e44ed94a18eb","Type":"ContainerStarted","Data":"96c33a030c48a240c777eeee691ecc29d14aedf0d5a8a6d250c9420dcb92c64e"}
Oct 30 20:57:50.600402 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:50.587971    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw" event={"ID":"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450","Type":"ContainerStarted","Data":"954a531ef719fccba0dae344c7d9f75af8b08821b4819d3a71ef81b341babdb4"}
Oct 30 20:57:50.895408 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:50.895166    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:51.001476 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:50.986798    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:51.001476 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:50.986932    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Oct 30 20:57:51.001476 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:50.986979    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf" podUID="37aaeb67-eddf-4e41-8980-e44ed94a18eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Oct 30 20:57:51.209456 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:51.195637    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:51.495496 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:51.494855    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:51.495496 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:51.494999    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Oct 30 20:57:51.495496 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:51.495061    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw" podUID="77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Oct 30 20:57:51.990386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:51.989785    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Oct 30 20:57:51.990386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:51.989855    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf" podUID="37aaeb67-eddf-4e41-8980-e44ed94a18eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Oct 30 20:57:52.505388 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:52.499557    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Oct 30 20:57:52.505388 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:52.499628    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw" podUID="77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Oct 30 20:57:52.515402 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:52.514560    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:52.987386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:52.986796    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Oct 30 20:57:52.987386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:52.986867    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf" podUID="37aaeb67-eddf-4e41-8980-e44ed94a18eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Oct 30 20:57:53.507387 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:53.506648    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Oct 30 20:57:53.507387 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:53.506720    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw" podUID="77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Oct 30 20:57:53.869387 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:53.868915    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:53.986386 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:57:53.980172    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:57:54.001384 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:53.986821    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Oct 30 20:57:54.001384 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:53.986883    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf" podUID="37aaeb67-eddf-4e41-8980-e44ed94a18eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Oct 30 20:57:54.101394 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:54.101236    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:54.497017 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:54.496976    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Oct 30 20:57:54.508806 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:54.497242    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw" podUID="77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Oct 30 20:57:54.843908 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:54.843844    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:54.990389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:54.989843    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Oct 30 20:57:54.990389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:54.989913    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf" podUID="37aaeb67-eddf-4e41-8980-e44ed94a18eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Oct 30 20:57:55.069384 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:55.068691    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:55.308636 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:55.308505    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:55.502386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:55.495833    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Oct 30 20:57:55.502386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:55.495904    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw" podUID="77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Oct 30 20:57:55.645087 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:55.640041    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:55.645087 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:55.642533    4948 generic.go:356] "Generic (PLEG): container finished" podID="a33086b6-3909-4317-ab87-877c36019f4e" containerID="1cd116f9569a4274caa8f8a583d67eed840de85f831dd84bd3dfb5f16cefa2d0" exitCode=0
Oct 30 20:57:55.645087 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:55.642697    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z" event={"ID":"a33086b6-3909-4317-ab87-877c36019f4e","Type":"ContainerDied","Data":"1cd116f9569a4274caa8f8a583d67eed840de85f831dd84bd3dfb5f16cefa2d0"}
Oct 30 20:57:55.645087 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:55.643195    4948 scope.go:122] "RemoveContainer" containerID="1cd116f9569a4274caa8f8a583d67eed840de85f831dd84bd3dfb5f16cefa2d0"
Oct 30 20:57:55.646207 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:55.645750    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:55.646207 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:55.645853    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:55.646207 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:55.645904    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:55.987431 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:55.986838    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Oct 30 20:57:55.987431 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:55.986910    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf" podUID="37aaeb67-eddf-4e41-8980-e44ed94a18eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Oct 30 20:57:56.104473 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:56.104431    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:56.616230 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:56.616189    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:56.708384 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:56.691298    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z" event={"ID":"a33086b6-3909-4317-ab87-877c36019f4e","Type":"ContainerStarted","Data":"427912bcf85b0e1b067283eaf0c294a054452943de212249575fbcd608518755"}
Oct 30 20:57:57.021006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:57.016770    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:57.021006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:57.018041    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:57.021006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:57.019353    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 20:57:57.125384 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:57.124919    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:57.126462 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:57.125944    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:57.129742 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:57.129706    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:57.199866 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:57.199831    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:57.379458 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:57.379420    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:57:57.380968 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:57.380937    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Oct 30 20:57:57.381118 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:57.380992    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z" podUID="a33086b6-3909-4317-ab87-877c36019f4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Oct 30 20:57:57.699768 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:57.699672    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 20:57:58.305001 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:58.304952    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:58.379875 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:58.379828    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Oct 30 20:57:58.380183 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:58.380151    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z" podUID="a33086b6-3909-4317-ab87-877c36019f4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Oct 30 20:57:58.608102 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:58.606950    4948 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:50512->10.132.0.51:15021: read: connection reset by peer" start-of-body=
Oct 30 20:57:58.608102 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:58.607014    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph" podUID="31514f00-a0a8-4892-a89d-504474b598be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:50512->10.132.0.51:15021: read: connection reset by peer"
Oct 30 20:57:58.706065 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:58.706032    4948 generic.go:356] "Generic (PLEG): container finished" podID="31514f00-a0a8-4892-a89d-504474b598be" containerID="4e66f4ee8afa86275293eb3f10b9c06fc0e1b5fb919b70de593d93631b15729a" exitCode=0
Oct 30 20:57:58.706345 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:58.706089    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph" event={"ID":"31514f00-a0a8-4892-a89d-504474b598be","Type":"ContainerDied","Data":"4e66f4ee8afa86275293eb3f10b9c06fc0e1b5fb919b70de593d93631b15729a"}
Oct 30 20:57:58.706621 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:58.706594    4948 scope.go:122] "RemoveContainer" containerID="4e66f4ee8afa86275293eb3f10b9c06fc0e1b5fb919b70de593d93631b15729a"
Oct 30 20:57:58.708734 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:58.708706    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:58.708830 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:58.708780    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:58.708830 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:58.708809    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:57:59.386386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:59.386061    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Oct 30 20:57:59.386386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:59.386123    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z" podUID="a33086b6-3909-4317-ab87-877c36019f4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Oct 30 20:57:59.390384 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:59.388324    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:57:59.716881 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:59.716792    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph" event={"ID":"31514f00-a0a8-4892-a89d-504474b598be","Type":"ContainerStarted","Data":"04efece3ca4cf57a45809cb8877dea647a0914c7c36836407d9b657282d71be6"}
Oct 30 20:57:59.842079 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:59.842046    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:57:59.842278 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:59.842256    4948 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Oct 30 20:57:59.842328 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:57:59.842304    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph" podUID="31514f00-a0a8-4892-a89d-504474b598be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Oct 30 20:58:00.382028 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:00.381986    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Oct 30 20:58:00.382389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:00.382325    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z" podUID="a33086b6-3909-4317-ab87-877c36019f4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Oct 30 20:58:00.467973 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:00.467932    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:00.841875 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:00.841836    4948 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Oct 30 20:58:00.842071 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:00.841893    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph" podUID="31514f00-a0a8-4892-a89d-504474b598be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Oct 30 20:58:01.380880 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.380835    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Oct 30 20:58:01.381219 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.381175    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z" podUID="a33086b6-3909-4317-ab87-877c36019f4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Oct 30 20:58:01.483284 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.483245    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:01.619772 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.619736    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"]
Oct 30 20:58:01.624934 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.624903    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"]
Oct 30 20:58:01.625258 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.625239    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.632593 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.632488    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-c4b379\"/\"simulator-w1-c4b379-kserve-self-signed-certs\""
Oct 30 20:58:01.632593 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.632584    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-c4b379\"/\"default-dockercfg-b99dh\""
Oct 30 20:58:01.632593 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.632592    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-c4b379\"/\"openshift-service-ca.crt\""
Oct 30 20:58:01.632887 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.632707    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-c4b379\"/\"kube-root-ca.crt\""
Oct 30 20:58:01.643336 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.643298    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-dshm\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.643629 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.643605    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-model-cache\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.643771 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.643755    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7cf7f07-fe2a-4871-a47c-da02e96356df-tls-certs\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.643891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.643873    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-tmp-dir\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.644032 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.644016    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d67h\" (UniqueName: \"kubernetes.io/projected/e7cf7f07-fe2a-4871-a47c-da02e96356df-kube-api-access-5d67h\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.644250 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.644232    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-home\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.739244 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.739199    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:01.745345 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.745286    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-home\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.745555 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.745430    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-dshm\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.745555 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.745450    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-model-cache\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.745555 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.745481    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7cf7f07-fe2a-4871-a47c-da02e96356df-tls-certs\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.745555 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.745513    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-tmp-dir\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.745692 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.745573    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d67h\" (UniqueName: \"kubernetes.io/projected/e7cf7f07-fe2a-4871-a47c-da02e96356df-kube-api-access-5d67h\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.745968 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.745916    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-tmp-dir\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.746130 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.746064    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-model-cache\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.746130 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.746114    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-home\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.748092 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.748065    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7cf7f07-fe2a-4871-a47c-da02e96356df-tls-certs\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.748538 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.748504    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-dshm\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.779836 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.779762    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d67h\" (UniqueName: \"kubernetes.io/projected/e7cf7f07-fe2a-4871-a47c-da02e96356df-kube-api-access-5d67h\") pod \"simulator-w1-c4b379-kserve-7854875dd4-w8czf\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") " pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:01.843708 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.842805    4948 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Oct 30 20:58:01.843708 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.842873    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph" podUID="31514f00-a0a8-4892-a89d-504474b598be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Oct 30 20:58:01.953736 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:01.953604    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:02.310758 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:02.310724    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"]
Oct 30 20:58:02.312746 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:58:02.312682    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7cf7f07_fe2a_4871_a47c_da02e96356df.slice/crio-dba3157137477d7c7ea8e57462bcbd36ec27b8270a05a3517f88b9c6cbd5caac WatchSource:0}: Error finding container dba3157137477d7c7ea8e57462bcbd36ec27b8270a05a3517f88b9c6cbd5caac: Status 404 returned error can't find the container with id dba3157137477d7c7ea8e57462bcbd36ec27b8270a05a3517f88b9c6cbd5caac
Oct 30 20:58:02.441098 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:02.441050    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:58:02.447221 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:02.447189    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 20:58:02.627851 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:02.622491    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:02.739451 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:02.739409    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" event={"ID":"e7cf7f07-fe2a-4871-a47c-da02e96356df","Type":"ContainerStarted","Data":"02645a344e3744aa0a6b3c41ea8200813c18259abe8c12375f109fe0c8017667"}
Oct 30 20:58:02.739732 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:02.739701    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" event={"ID":"e7cf7f07-fe2a-4871-a47c-da02e96356df","Type":"ContainerStarted","Data":"dba3157137477d7c7ea8e57462bcbd36ec27b8270a05a3517f88b9c6cbd5caac"}
Oct 30 20:58:02.776386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:02.775720    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podStartSLOduration=1.775694057 podStartE2EDuration="1.775694057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:58:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:58:02.761817187 +0000 UTC m=+1150.581329177" watchObservedRunningTime="2026-10-30 20:58:02.775694057 +0000 UTC m=+1150.595206046"
Oct 30 20:58:02.842171 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:02.842133    4948 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Oct 30 20:58:02.842404 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:02.842191    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph" podUID="31514f00-a0a8-4892-a89d-504474b598be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Oct 30 20:58:02.955448 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:02.954521    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:03.562682 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:03.562605    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:03.842059 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:03.842021    4948 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Oct 30 20:58:03.842492 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:03.842089    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph" podUID="31514f00-a0a8-4892-a89d-504474b598be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Oct 30 20:58:04.394977 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:04.394936    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:04.841883 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:04.841840    4948 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Oct 30 20:58:04.842108 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:04.841905    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph" podUID="31514f00-a0a8-4892-a89d-504474b598be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Oct 30 20:58:05.249049 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:05.248937    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:05.451325 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:05.451283    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:05.847128 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:05.847086    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:58:05.847669 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:05.847592    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:58:05.848657 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:05.848630    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 20:58:05.986635 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:05.986596    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:06.324045 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:06.323927    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:07.131225 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:07.131180    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:07.405966 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:07.405855    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:08.119478 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:08.119438    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:08.721293 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:08.721256    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:08.979066 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:08.978968    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:09.690748 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:09.690698    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:10.386821 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:10.386789    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:11.188450 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:11.188411    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:11.884211 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:11.884175    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:11.966384 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:11.963928    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:11.997724 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:11.997692    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:12.090911 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:12.090876    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:12.692919 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:12.692882    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:12.809740 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:12.809708    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 20:58:13.581654 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.581609    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"]
Oct 30 20:58:13.585999 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.585944    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.586747 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.586696    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:13.597192 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.597167    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"]
Oct 30 20:58:13.600169 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.600132    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-39fb96\"/\"simulator-w6-39fb96-kserve-self-signed-certs\""
Oct 30 20:58:13.600333 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.600183    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-39fb96\"/\"kube-root-ca.crt\""
Oct 30 20:58:13.600791 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.600772    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-39fb96\"/\"default-dockercfg-flj6l\""
Oct 30 20:58:13.600880 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.600794    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-39fb96\"/\"openshift-service-ca.crt\""
Oct 30 20:58:13.757542 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.757497    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-tmp-dir\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.757898 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.757869    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-dshm\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.758083 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.758050    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-model-cache\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.758343 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.758313    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4tpm\" (UniqueName: \"kubernetes.io/projected/46092a70-fe9a-42be-877a-614c1ddaee73-kube-api-access-z4tpm\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.758531 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.758516    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46092a70-fe9a-42be-877a-614c1ddaee73-tls-certs\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.758720 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.758707    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-home\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.790608 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.790571    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:13.859845 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.859752    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-model-cache\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.860033 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.859850    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4tpm\" (UniqueName: \"kubernetes.io/projected/46092a70-fe9a-42be-877a-614c1ddaee73-kube-api-access-z4tpm\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.860033 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.859879    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46092a70-fe9a-42be-877a-614c1ddaee73-tls-certs\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.860033 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.859923    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-home\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.860197 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.860129    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-tmp-dir\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.860260 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.860220    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-dshm\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.860309 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.860254    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-model-cache\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.860352 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.860323    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-home\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.860501 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.860483    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-tmp-dir\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.862370 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.862342    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-dshm\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.862657 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.862640    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46092a70-fe9a-42be-877a-614c1ddaee73-tls-certs\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.873905 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.873865    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4tpm\" (UniqueName: \"kubernetes.io/projected/46092a70-fe9a-42be-877a-614c1ddaee73-kube-api-access-z4tpm\") pod \"simulator-w6-39fb96-kserve-9c895bbc6-pfqrc\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") " pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:13.901702 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:13.901668    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:14.184800 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:14.184767    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"]
Oct 30 20:58:14.186588 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:58:14.186556    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46092a70_fe9a_42be_877a_614c1ddaee73.slice/crio-c4ffb410ccc9c699d3f40796e0c160abff2fb187e536c10676a7b4678b1e66d0 WatchSource:0}: Error finding container c4ffb410ccc9c699d3f40796e0c160abff2fb187e536c10676a7b4678b1e66d0: Status 404 returned error can't find the container with id c4ffb410ccc9c699d3f40796e0c160abff2fb187e536c10676a7b4678b1e66d0
Oct 30 20:58:14.412843 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:14.412803    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:14.813144 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:14.813105    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" event={"ID":"46092a70-fe9a-42be-877a-614c1ddaee73","Type":"ContainerStarted","Data":"24bc7217a6025469c4ec903b45bb44741a51e812b41b36cdadb6596b87ad2fad"}
Oct 30 20:58:14.813144 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:14.813149    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" event={"ID":"46092a70-fe9a-42be-877a-614c1ddaee73","Type":"ContainerStarted","Data":"c4ffb410ccc9c699d3f40796e0c160abff2fb187e536c10676a7b4678b1e66d0"}
Oct 30 20:58:14.834533 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:14.834471    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podStartSLOduration=1.8344480380000001 podStartE2EDuration="1.834448038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:58:14.832251423 +0000 UTC m=+1162.651763413" watchObservedRunningTime="2026-10-30 20:58:14.834448038 +0000 UTC m=+1162.653960027"
Oct 30 20:58:14.902215 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:14.902172    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:15.332973 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:15.332929    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:16.084348 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:16.084308    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:16.795624 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:16.795571    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:17.879869 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:17.879827    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:18.822061 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:18.822010    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:19.495477 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:19.495435    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:20.169937 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:20.169890    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:20.369922 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:20.369881    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:20.890903 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:20.890857    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:21.093326 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:21.093289    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:21.690442 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:21.690405    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:22.402863 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:22.402822    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:23.303127 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:23.303092    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:23.902582 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:23.902555    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:23.915988 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:23.915954    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:23.951555 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:23.951526    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 20:58:23.961433 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:58:23.961388    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:58:23.993575 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:23.993533    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:24.800662 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:24.800619    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:25.500979 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:25.500937    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:26.204271 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:26.204236    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:27.140482 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:27.140443    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:27.625619 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:27.625484    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:28.096891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:28.096854    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:28.890190 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:28.890143    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:29.673624 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:29.673544    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:30.382489 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:30.382451    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:31.144121 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:31.144038    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:31.348413 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:31.348373    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:31.993268 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:31.993231    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:32.786986 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:32.786944    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:33.742271 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:33.742232    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:34.486697 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:34.486652    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:35.295392 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:35.295323    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:35.750380 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:35.749457    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:36.225803 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:36.225767    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:37.048278 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:37.048240    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:37.880705 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:37.880668    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:38.594228 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:38.594189    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:38.798276 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:38.798211    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:39.295245 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:39.295204    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:39.998375 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:39.998332    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:40.782782 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:40.782743    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:41.490075 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:41.490039    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:42.275591 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:42.275541    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:42.983774 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:42.983735    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:43.684085 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:43.684049    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:43.881476 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:43.881441    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:45.103389 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:45.103306    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:46.192786 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:46.192747    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:47.242138 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:47.242097    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:47.977544 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:47.977499    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:48.769674 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:48.769639    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:49.692569 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:49.692520    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:50.584305 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:50.584263    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:51.289200 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:51.289162    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:51.494110 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:51.494073    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:51.992006 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:51.991959    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:52.424129 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:52.424099    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 20:58:52.424468 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:52.424339    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 20:58:52.840646 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:52.840613    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:53.684547 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:53.684485    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:53.930983 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:58:53.930940    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:58:54.487962 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:54.487915    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:55.293227 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:55.293182    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:55.922080 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:55.922038    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"]
Oct 30 20:58:55.931263 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:55.931219    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:55.937644 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:55.937610    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-65968b-openshift-default-dockercfg-vzgwf\""
Oct 30 20:58:55.941238 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:55.941200    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"]
Oct 30 20:58:56.010038 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.009993    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:56.111874 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.111831    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.111874 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.111876    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24dd0839-321b-426a-a667-42b366bba980-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.112114 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.111980    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.112114 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.112095    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.112186 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.112128    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.112186 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.112155    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24dd0839-321b-426a-a667-42b366bba980-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.112186 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.112173    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.112277 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.112228    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24dd0839-321b-426a-a667-42b366bba980-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.112321 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.112308    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn225\" (UniqueName: \"kubernetes.io/projected/24dd0839-321b-426a-a667-42b366bba980-kube-api-access-jn225\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.213250 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.213131    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn225\" (UniqueName: \"kubernetes.io/projected/24dd0839-321b-426a-a667-42b366bba980-kube-api-access-jn225\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.213250 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.213225    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.213250 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.213255    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24dd0839-321b-426a-a667-42b366bba980-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.213638 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.213305    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.213638 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.213399    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.213638 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.213429    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.213638 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.213455    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24dd0839-321b-426a-a667-42b366bba980-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.213638 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.213481    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.213638 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.213523    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24dd0839-321b-426a-a667-42b366bba980-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.214012 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.213904    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.214091 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.214071    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.214274 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.214219    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.214343 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.214228    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.214645 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.214621    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24dd0839-321b-426a-a667-42b366bba980-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.215979 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.215951    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.216210 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.216191    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24dd0839-321b-426a-a667-42b366bba980-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.226255 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.226214    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24dd0839-321b-426a-a667-42b366bba980-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.226255 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.226232    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn225\" (UniqueName: \"kubernetes.io/projected/24dd0839-321b-426a-a667-42b366bba980-kube-api-access-jn225\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.256124 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.256082    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:56.546635 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.546605    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"]
Oct 30 20:58:56.548394 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:58:56.548344    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24dd0839_321b_426a_a667_42b366bba980.slice/crio-96d73fd9b5388e446daf64b799f396ad2d8ad4189485308fc54096883187d87f WatchSource:0}: Error finding container 96d73fd9b5388e446daf64b799f396ad2d8ad4189485308fc54096883187d87f: Status 404 returned error can't find the container with id 96d73fd9b5388e446daf64b799f396ad2d8ad4189485308fc54096883187d87f
Oct 30 20:58:56.551019 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.550982    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:58:56.551113 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.551055    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:58:56.551113 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.551089    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:58:56.807700 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:56.807595    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:57.137394 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:57.137338    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk" event={"ID":"24dd0839-321b-426a-a667-42b366bba980","Type":"ContainerStarted","Data":"d627d6fa3cd7ceeb9df8d07ed0780750b788a0472db8441612217ab8577ed286"}
Oct 30 20:58:57.137604 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:57.137416    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk" event={"ID":"24dd0839-321b-426a-a667-42b366bba980","Type":"ContainerStarted","Data":"96d73fd9b5388e446daf64b799f396ad2d8ad4189485308fc54096883187d87f"}
Oct 30 20:58:57.171384 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:57.170969    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk" podStartSLOduration=2.170948669 podStartE2EDuration="2.170948669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:58:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:58:57.169952593 +0000 UTC m=+1204.989464582" watchObservedRunningTime="2026-10-30 20:58:57.170948669 +0000 UTC m=+1204.990460658"
Oct 30 20:58:57.266804 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:57.266766    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:58:57.274542 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:57.274499    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 20:58:57.274859 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:57.274822    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk" podUID="24dd0839-321b-426a-a667-42b366bba980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 20:58:57.771811 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:57.771772    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:58.265405 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:58.264879    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 20:58:58.265405 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:58.264950    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk" podUID="24dd0839-321b-426a-a667-42b366bba980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 20:58:58.515505 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:58.515410    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:58:59.272386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:59.271862    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 20:58:59.272386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:59.271936    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk" podUID="24dd0839-321b-426a-a667-42b366bba980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 20:58:59.418022 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:58:59.417978    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:00.265781 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:00.265738    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 20:59:00.266123 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:00.266083    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk" podUID="24dd0839-321b-426a-a667-42b366bba980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 20:59:00.316468 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:00.316434    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:01.264387 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:01.263832    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 20:59:01.264387 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:01.263900    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk" podUID="24dd0839-321b-426a-a667-42b366bba980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 20:59:01.619388 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:01.616728    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:02.274828 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:02.274787    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Oct 30 20:59:02.275063 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:02.274858    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk" podUID="24dd0839-321b-426a-a667-42b366bba980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Oct 30 20:59:02.737379 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:02.737308    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:03.498840 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:03.498784    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:04.298546 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:04.298486    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:59:04.299539 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:04.298592    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk" podUID="24dd0839-321b-426a-a667-42b366bba980" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:59:04.392248 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:04.392209    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:59:04.394260 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:04.394225    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:59:04.396024 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:04.395955    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 20:59:05.616512 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:05.616479    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:06.448816 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:06.448775    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:07.380317 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:07.380274    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:08.160960 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:08.160917    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:08.937886 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:08.937845    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:09.611521 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:09.611483    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:10.317413 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.317339    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:10.476798 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.476764    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"]
Oct 30 20:59:10.480799 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.480772    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.485252 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.485213    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-32a969-openshift-default-dockercfg-tkmt5\""
Oct 30 20:59:10.498050 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.498018    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"]
Oct 30 20:59:10.588485 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.588446    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.588738 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.588570    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.588738 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.588668    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvjrx\" (UniqueName: \"kubernetes.io/projected/17307650-956b-4f4c-be36-cbfdf82feb0d-kube-api-access-hvjrx\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.588861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.588735    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.588861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.588795    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.588861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.588824    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17307650-956b-4f4c-be36-cbfdf82feb0d-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.588861 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.588849    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.589039 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.588966    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.589076 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.589043    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.661302 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.661258    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"]
Oct 30 20:59:10.666383 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.666325    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.681977 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.681934    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-c2d1eb-openshift-default-dockercfg-x4gzl\""
Oct 30 20:59:10.688656 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.688618    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"]
Oct 30 20:59:10.690021 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.689989    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.690190 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.690152    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.690257 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.690195    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17307650-956b-4f4c-be36-cbfdf82feb0d-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.690257 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.690225    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.690401 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.690257    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.690401 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.690294    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.690401 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.690335    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.690564 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.690422    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.690564 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.690543    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvjrx\" (UniqueName: \"kubernetes.io/projected/17307650-956b-4f4c-be36-cbfdf82feb0d-kube-api-access-hvjrx\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.690834 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.690804    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.691129 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.691100    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.691301 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.691278    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.692102 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.692075    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.692394 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.692340    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17307650-956b-4f4c-be36-cbfdf82feb0d-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.693282 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.693255    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.694071 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.694049    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.705438 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.705399    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvjrx\" (UniqueName: \"kubernetes.io/projected/17307650-956b-4f4c-be36-cbfdf82feb0d-kube-api-access-hvjrx\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.735440 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.735404    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.791771 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.791724    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.791771 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.791771    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.792048 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.791927    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.792048 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.791984    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.792119 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.792075    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.792176 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.792120    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.792234 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.792219    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gf7g\" (UniqueName: \"kubernetes.io/projected/ec5914af-5cdd-425a-a0d3-9b6ba2947947-kube-api-access-5gf7g\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.792271 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.792253    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.792317 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.792281    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.798570 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.798532    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:10.893147 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.893106    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.893323 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.893158    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.893323 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.893187    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.893323 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.893215    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.893323 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.893270    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gf7g\" (UniqueName: \"kubernetes.io/projected/ec5914af-5cdd-425a-a0d3-9b6ba2947947-kube-api-access-5gf7g\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.893323 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.893296    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.893323 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.893321    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.893568 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.893346    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.893568 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.893383    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.893907 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.893880    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.894011 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.893887    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.894011 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.893949    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.894242 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.894216    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.894493 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.894470    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.896352 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.896326    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.896783 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.896764    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.910555 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.910515    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.911539 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.911509    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gf7g\" (UniqueName: \"kubernetes.io/projected/ec5914af-5cdd-425a-a0d3-9b6ba2947947-kube-api-access-5gf7g\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:10.986480 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:10.986440    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:11.089015 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:11.088974    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"]
Oct 30 20:59:11.090328 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:59:11.090276    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17307650_956b_4f4c_be36_cbfdf82feb0d.slice/crio-43b205328d6d3da89915f6ed45755198c7e0fad132b7092659260002d7b3cd61 WatchSource:0}: Error finding container 43b205328d6d3da89915f6ed45755198c7e0fad132b7092659260002d7b3cd61: Status 404 returned error can't find the container with id 43b205328d6d3da89915f6ed45755198c7e0fad132b7092659260002d7b3cd61
Oct 30 20:59:11.093913 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:11.093864    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:59:11.094025 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:11.093977    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:59:11.094064 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:11.094025    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:59:11.192448 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:11.192407    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:11.292688 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:11.292655    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"]
Oct 30 20:59:11.294088 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:59:11.294060    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5914af_5cdd_425a_a0d3_9b6ba2947947.slice/crio-66291f1021492a359ebbf258b2d2b798146fee9b82dc0eee14923bcc3ee724ef WatchSource:0}: Error finding container 66291f1021492a359ebbf258b2d2b798146fee9b82dc0eee14923bcc3ee724ef: Status 404 returned error can't find the container with id 66291f1021492a359ebbf258b2d2b798146fee9b82dc0eee14923bcc3ee724ef
Oct 30 20:59:11.297332 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:11.297295    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:59:11.297485 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:11.297407    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:59:11.297485 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:11.297455    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 20:59:11.302830 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:11.302798    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr" event={"ID":"17307650-956b-4f4c-be36-cbfdf82feb0d","Type":"ContainerStarted","Data":"746d5edb499d6bc5a27cd6d11b3e8c6e296f1b2997a4cadc767ace0a222ac20f"}
Oct 30 20:59:11.302975 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:11.302864    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr" event={"ID":"17307650-956b-4f4c-be36-cbfdf82feb0d","Type":"ContainerStarted","Data":"43b205328d6d3da89915f6ed45755198c7e0fad132b7092659260002d7b3cd61"}
Oct 30 20:59:11.326914 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:11.326863    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr" podStartSLOduration=1.3268438169999999 podStartE2EDuration="1.326843817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:59:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:59:11.325105758 +0000 UTC m=+1219.144617772" watchObservedRunningTime="2026-10-30 20:59:11.326843817 +0000 UTC m=+1219.146355808"
Oct 30 20:59:11.798780 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:11.798686    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:12.004385 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:12.004184    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:12.314776 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:12.314739    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw" event={"ID":"ec5914af-5cdd-425a-a0d3-9b6ba2947947","Type":"ContainerStarted","Data":"0291f38cd5bb8b5194626bedac9b86738af8cb730807416687f5b428d63248e9"}
Oct 30 20:59:12.314971 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:12.314795    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw" event={"ID":"ec5914af-5cdd-425a-a0d3-9b6ba2947947","Type":"ContainerStarted","Data":"66291f1021492a359ebbf258b2d2b798146fee9b82dc0eee14923bcc3ee724ef"}
Oct 30 20:59:12.341429 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:12.341370    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw" podStartSLOduration=2.341336794 podStartE2EDuration="2.341336794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:59:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:59:12.339006932 +0000 UTC m=+1220.158518919" watchObservedRunningTime="2026-10-30 20:59:12.341336794 +0000 UTC m=+1220.160848781"
Oct 30 20:59:12.806395 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:12.805984    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:59:12.806395 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:12.806064    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr" podUID="17307650-956b-4f4c-be36-cbfdf82feb0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 20:59:12.890399 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:12.889129    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:12.991386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:12.990435    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:12.991386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:12.991328    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 20:59:12.991687 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:12.991412    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw" podUID="ec5914af-5cdd-425a-a0d3-9b6ba2947947" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 20:59:13.781387 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:13.781012    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:13.801860 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:13.801820    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:59:13.802159 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:13.802126    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr" podUID="17307650-956b-4f4c-be36-cbfdf82feb0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 20:59:13.991903 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:13.991854    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 20:59:13.993422 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:13.993380    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw" podUID="ec5914af-5cdd-425a-a0d3-9b6ba2947947" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 20:59:14.699849 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:14.699809    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:14.803879 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:14.803837    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:59:14.804562 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:14.804500    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr" podUID="17307650-956b-4f4c-be36-cbfdf82feb0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 20:59:14.995016 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:14.994907    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 20:59:14.995323 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:14.995292    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw" podUID="ec5914af-5cdd-425a-a0d3-9b6ba2947947" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 20:59:15.799617 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:15.799576    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:59:15.799924 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:15.799893    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr" podUID="17307650-956b-4f4c-be36-cbfdf82feb0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 20:59:15.992873 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:15.992827    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 20:59:15.993609 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:15.993565    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw" podUID="ec5914af-5cdd-425a-a0d3-9b6ba2947947" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 20:59:16.009553 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:16.009511    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:16.803386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:16.802558    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:59:16.803386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:16.802718    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr" podUID="17307650-956b-4f4c-be36-cbfdf82feb0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 20:59:16.990891 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:16.990850    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 20:59:16.991452 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:16.991412    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw" podUID="ec5914af-5cdd-425a-a0d3-9b6ba2947947" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 20:59:17.073575 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:17.070096    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:17.799093 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:17.799042    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Oct 30 20:59:17.799330 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:17.799116    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr" podUID="17307650-956b-4f4c-be36-cbfdf82feb0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Oct 30 20:59:17.876186 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:17.876139    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:17.987663 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:17.987620    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 20:59:17.987918 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:17.987692    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw" podUID="ec5914af-5cdd-425a-a0d3-9b6ba2947947" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 20:59:18.776597 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:18.776558    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:18.803601 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:18.803566    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:18.803871 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:18.803851    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:18.804747 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:18.804729    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 20:59:18.991966 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:18.991933    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:18.992352 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:18.992331    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:18.993292 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:18.993269    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 20:59:19.599249 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:19.599211    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:20.292795 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:20.292752    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:21.004338 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:21.004300    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:21.686189 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:21.686137    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:22.384091 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:22.384055    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:23.075444 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:23.075404    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:23.883857 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:23.883814    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:23.930930 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:59:23.930889    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:59:24.992132 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:24.992079    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:25.904250 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:25.904217    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:26.596096 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:26.596053    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:27.306648 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:27.306602    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:28.064512 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:28.064474    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:28.804843 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:28.804797    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:29.586734 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:29.586698    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:30.541199 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:30.541166    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:31.306467 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:31.306424    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:32.109395 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:32.109339    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:33.084285 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:33.084248    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:33.882795 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:33.882748    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:34.685466 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:34.685414    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:35.490160 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:35.490121    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:36.178519 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:36.178483    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:36.978178 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:36.978135    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:37.662699 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:37.662581    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:38.368185 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:38.368138    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:39.133572 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:39.133461    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:40.091044 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:40.091000    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:40.893099 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:40.893018    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:41.688851 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:41.688814    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:42.593940 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:42.593900    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:43.461663 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:43.461601    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:43.745033 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:43.744934    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:44.537277 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:44.537238    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:45.288008 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:45.287940    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:46.569724 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:46.569677    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:47.327128 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:47.326975    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:48.177524 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:48.177487    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:48.883455 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:48.883411    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:49.600427 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:49.600383    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:50.388298 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:50.388254    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:51.178165 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:51.178116    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:52.816386 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:52.816014    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:53.693682 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:53.693643    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:53.938549 ip-10-0-142-183 kubenswrapper[4948]: E1030 20:59:53.938505    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 20:59:54.563626 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.563582    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:54.576591 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.576526    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"]
Oct 30 20:59:54.588230 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.588196    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.606333 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.606275    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-39fb96\"/\"distinct-w6-39fb96-kserve-self-signed-certs\""
Oct 30 20:59:54.613662 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.613624    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"]
Oct 30 20:59:54.680421 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.680336    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-model-cache\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.680690 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.680449    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-tls-certs\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.680690 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.680511    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-dshm\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.680690 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.680613    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdgbp\" (UniqueName: \"kubernetes.io/projected/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-kube-api-access-rdgbp\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.680890 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.680714    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-home\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.680890 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.680797    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-tmp-dir\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.779693 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.779647    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:54.783463 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.781913    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-model-cache\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.788669 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.788627    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-tls-certs\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.788992 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.788968    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-dshm\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.789387 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.789345    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdgbp\" (UniqueName: \"kubernetes.io/projected/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-kube-api-access-rdgbp\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.789688 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.789632    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-home\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.789930 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.789912    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-tmp-dir\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.792925 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.791432    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-tmp-dir\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.794649 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.782476    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-model-cache\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.794815 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.793470    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-home\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.812860 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.812820    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-dshm\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.821306 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.821133    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-tls-certs\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.827058 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.827024    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdgbp\" (UniqueName: \"kubernetes.io/projected/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-kube-api-access-rdgbp\") pod \"distinct-w6-39fb96-kserve-884ff796-sfcwv\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:54.944582 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:54.944530    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:55.230111 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:55.230071    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"]
Oct 30 20:59:55.231850 ip-10-0-142-183 kubenswrapper[4948]: W1030 20:59:55.231811    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode85aacf2_8dd5_4bc7_bfdb_8a5966172785.slice/crio-3940ba9e134eff56add1c2edc56bf38b153710ebaf9ec30567b71135b4b356cb WatchSource:0}: Error finding container 3940ba9e134eff56add1c2edc56bf38b153710ebaf9ec30567b71135b4b356cb: Status 404 returned error can't find the container with id 3940ba9e134eff56add1c2edc56bf38b153710ebaf9ec30567b71135b4b356cb
Oct 30 20:59:55.406594 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:55.406552    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:55.857972 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:55.857930    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" event={"ID":"e85aacf2-8dd5-4bc7-bfdb-8a5966172785","Type":"ContainerStarted","Data":"8de156dc54e012b6a86c53948b785e20c8945068ef2df75de95bf0604ab56f4d"}
Oct 30 20:59:55.857972 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:55.857984    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" event={"ID":"e85aacf2-8dd5-4bc7-bfdb-8a5966172785","Type":"ContainerStarted","Data":"3940ba9e134eff56add1c2edc56bf38b153710ebaf9ec30567b71135b4b356cb"}
Oct 30 20:59:55.883003 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:55.882748    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podStartSLOduration=1.8827242530000001 podStartE2EDuration="1.882724253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:59:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:59:55.877957383 +0000 UTC m=+1263.697469372" watchObservedRunningTime="2026-10-30 20:59:55.882724253 +0000 UTC m=+1263.702236239"
Oct 30 20:59:55.945267 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:55.945227    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 20:59:56.105565 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:56.105529    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:56.804581 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:56.804525    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:57.967596 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:57.967554    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:58.787057 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:58.787018    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 20:59:59.692254 ip-10-0-142-183 kubenswrapper[4948]: I1030 20:59:59.692218    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:00.173214 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.173171    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv"]
Oct 30 21:00:00.178813 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.178774    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv"
Oct 30 21:00:00.184715 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.184676    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv"]
Oct 30 21:00:00.192297 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.192242    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:00:00.194139 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.193895    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv"
Oct 30 21:00:00.194703 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.194677    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv"]
Oct 30 21:00:00.213152 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.213108    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv"]
Oct 30 21:00:00.293015 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.292963    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvxdj\" (UniqueName: \"kubernetes.io/projected/1d5e5f59-44ec-40aa-844b-04481d593661-kube-api-access-vvxdj\") pod \"maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv\" (UID: \"1d5e5f59-44ec-40aa-844b-04481d593661\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv"
Oct 30 21:00:00.293218 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.293164    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bca6091c-7129-4d4f-ad68-8edc2f075b36-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv\" (UID: \"bca6091c-7129-4d4f-ad68-8edc2f075b36\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv"
Oct 30 21:00:00.293218 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.293207    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhfqv\" (UniqueName: \"kubernetes.io/projected/bca6091c-7129-4d4f-ad68-8edc2f075b36-kube-api-access-vhfqv\") pod \"maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv\" (UID: \"bca6091c-7129-4d4f-ad68-8edc2f075b36\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv"
Oct 30 21:00:00.293308 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.293276    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d5e5f59-44ec-40aa-844b-04481d593661-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv\" (UID: \"1d5e5f59-44ec-40aa-844b-04481d593661\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv"
Oct 30 21:00:00.394998 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.394953    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bca6091c-7129-4d4f-ad68-8edc2f075b36-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv\" (UID: \"bca6091c-7129-4d4f-ad68-8edc2f075b36\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv"
Oct 30 21:00:00.394998 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.394998    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhfqv\" (UniqueName: \"kubernetes.io/projected/bca6091c-7129-4d4f-ad68-8edc2f075b36-kube-api-access-vhfqv\") pod \"maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv\" (UID: \"bca6091c-7129-4d4f-ad68-8edc2f075b36\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv"
Oct 30 21:00:00.395314 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.395121    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d5e5f59-44ec-40aa-844b-04481d593661-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv\" (UID: \"1d5e5f59-44ec-40aa-844b-04481d593661\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv"
Oct 30 21:00:00.395314 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.395271    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvxdj\" (UniqueName: \"kubernetes.io/projected/1d5e5f59-44ec-40aa-844b-04481d593661-kube-api-access-vvxdj\") pod \"maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv\" (UID: \"1d5e5f59-44ec-40aa-844b-04481d593661\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv"
Oct 30 21:00:00.395794 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.395774    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bca6091c-7129-4d4f-ad68-8edc2f075b36-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv\" (UID: \"bca6091c-7129-4d4f-ad68-8edc2f075b36\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv"
Oct 30 21:00:00.395903 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.395884    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d5e5f59-44ec-40aa-844b-04481d593661-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv\" (UID: \"1d5e5f59-44ec-40aa-844b-04481d593661\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv"
Oct 30 21:00:00.419178 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.419129    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvxdj\" (UniqueName: \"kubernetes.io/projected/1d5e5f59-44ec-40aa-844b-04481d593661-kube-api-access-vvxdj\") pod \"maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv\" (UID: \"1d5e5f59-44ec-40aa-844b-04481d593661\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv"
Oct 30 21:00:00.420045 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.420015    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhfqv\" (UniqueName: \"kubernetes.io/projected/bca6091c-7129-4d4f-ad68-8edc2f075b36-kube-api-access-vhfqv\") pod \"maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv\" (UID: \"bca6091c-7129-4d4f-ad68-8edc2f075b36\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv"
Oct 30 21:00:00.462494 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.462353    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:00.518026 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.517986    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv"
Oct 30 21:00:00.527709 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.527679    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv"
Oct 30 21:00:00.808697 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.808660    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv"]
Oct 30 21:00:00.809935 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:00:00.809908    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5e5f59_44ec_40aa_844b_04481d593661.slice/crio-6002426b495777a5ccca9b73732358f7ef503b3288184c0f1b1d778ac96687df WatchSource:0}: Error finding container 6002426b495777a5ccca9b73732358f7ef503b3288184c0f1b1d778ac96687df: Status 404 returned error can't find the container with id 6002426b495777a5ccca9b73732358f7ef503b3288184c0f1b1d778ac96687df
Oct 30 21:00:00.812189 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.812165    4948 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:00:00.819540 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.819513    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv"]
Oct 30 21:00:00.821065 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:00:00.821033    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca6091c_7129_4d4f_ad68_8edc2f075b36.slice/crio-1610fa01ecd645a8a257f3bc6bb1a3b48a6e5cf492300f22bf462b7068c3662f WatchSource:0}: Error finding container 1610fa01ecd645a8a257f3bc6bb1a3b48a6e5cf492300f22bf462b7068c3662f: Status 404 returned error can't find the container with id 1610fa01ecd645a8a257f3bc6bb1a3b48a6e5cf492300f22bf462b7068c3662f
Oct 30 21:00:00.903051 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.902985    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv" event={"ID":"1d5e5f59-44ec-40aa-844b-04481d593661","Type":"ContainerStarted","Data":"6002426b495777a5ccca9b73732358f7ef503b3288184c0f1b1d778ac96687df"}
Oct 30 21:00:00.904498 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:00.904464    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv" event={"ID":"bca6091c-7129-4d4f-ad68-8edc2f075b36","Type":"ContainerStarted","Data":"1610fa01ecd645a8a257f3bc6bb1a3b48a6e5cf492300f22bf462b7068c3662f"}
Oct 30 21:00:01.187344 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:01.187299    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:01.986798 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:01.986741    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:02.773929 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:02.773895    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:03.869677 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:03.869639    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:04.079885 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:04.079825    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:04.592297 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:04.592256    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:04.946293 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:04.945439    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 21:00:04.958097 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:04.958062    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 21:00:04.994648 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:04.994608    4948 generic.go:356] "Generic (PLEG): container finished" podID="1d5e5f59-44ec-40aa-844b-04481d593661" containerID="4526f528952bbe20ca0f9d921f1d83ae575f1d8fa1d9a5ee58af7716091721bc" exitCode=60
Oct 30 21:00:04.994848 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:04.994692    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv" event={"ID":"1d5e5f59-44ec-40aa-844b-04481d593661","Type":"ContainerDied","Data":"4526f528952bbe20ca0f9d921f1d83ae575f1d8fa1d9a5ee58af7716091721bc"}
Oct 30 21:00:04.995107 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:04.995084    4948 scope.go:122] "RemoveContainer" containerID="4526f528952bbe20ca0f9d921f1d83ae575f1d8fa1d9a5ee58af7716091721bc"
Oct 30 21:00:04.996847 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:04.996822    4948 generic.go:356] "Generic (PLEG): container finished" podID="bca6091c-7129-4d4f-ad68-8edc2f075b36" containerID="3101e9e4da80af9aba0fcf9a85e5241ca84d83f726f58ab451bcb10c8b70d624" exitCode=60
Oct 30 21:00:04.996975 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:04.996903    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv" event={"ID":"bca6091c-7129-4d4f-ad68-8edc2f075b36","Type":"ContainerDied","Data":"3101e9e4da80af9aba0fcf9a85e5241ca84d83f726f58ab451bcb10c8b70d624"}
Oct 30 21:00:04.997314 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:04.997289    4948 scope.go:122] "RemoveContainer" containerID="3101e9e4da80af9aba0fcf9a85e5241ca84d83f726f58ab451bcb10c8b70d624"
Oct 30 21:00:05.009234 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:05.009202    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 21:00:05.486183 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:05.486144    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:06.007052 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:06.006999    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv" event={"ID":"bca6091c-7129-4d4f-ad68-8edc2f075b36","Type":"ContainerStarted","Data":"928a354fc3c6c124382298d730fde8ab0d9196457642cfcacd698e46a2f50409"}
Oct 30 21:00:06.009493 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:06.009451    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv" event={"ID":"1d5e5f59-44ec-40aa-844b-04481d593661","Type":"ContainerStarted","Data":"5ac0a9e3c5850c6c53bd33c802ffd7bad3a89ef02a24e13501d2c015bba86202"}
Oct 30 21:00:06.028530 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:06.028461    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv" podStartSLOduration=2.98033793 podStartE2EDuration="6.028443145s" totalImagesPullingTime="3.048105215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:06.026477573 +0000 UTC m=+1273.845989560" watchObservedRunningTime="2026-10-30 21:00:06.028443145 +0000 UTC m=+1273.847955131"
Oct 30 21:00:06.046092 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:06.046030    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv" podStartSLOduration=2.991021118 podStartE2EDuration="6.04601416s" totalImagesPullingTime="3.054993042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:06.044222567 +0000 UTC m=+1273.863734555" watchObservedRunningTime="2026-10-30 21:00:06.04601416 +0000 UTC m=+1273.865526146"
Oct 30 21:00:06.192376 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:06.192329    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:06.886184 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:06.882157    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:07.018187 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:07.018146    4948 generic.go:356] "Generic (PLEG): container finished" podID="1d5e5f59-44ec-40aa-844b-04481d593661" containerID="5ac0a9e3c5850c6c53bd33c802ffd7bad3a89ef02a24e13501d2c015bba86202" exitCode=60
Oct 30 21:00:07.018707 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:07.018232    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv" event={"ID":"1d5e5f59-44ec-40aa-844b-04481d593661","Type":"ContainerDied","Data":"5ac0a9e3c5850c6c53bd33c802ffd7bad3a89ef02a24e13501d2c015bba86202"}
Oct 30 21:00:07.018707 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:07.018303    4948 scope.go:122] "RemoveContainer" containerID="4526f528952bbe20ca0f9d921f1d83ae575f1d8fa1d9a5ee58af7716091721bc"
Oct 30 21:00:07.018707 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:07.018648    4948 scope.go:122] "RemoveContainer" containerID="5ac0a9e3c5850c6c53bd33c802ffd7bad3a89ef02a24e13501d2c015bba86202"
Oct 30 21:00:07.018992 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:00:07.018970    4948 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv_odh-ai-gateway-infra(1d5e5f59-44ec-40aa-844b-04481d593661)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv" podUID="1d5e5f59-44ec-40aa-844b-04481d593661"
Oct 30 21:00:07.020793 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:07.020770    4948 generic.go:356] "Generic (PLEG): container finished" podID="bca6091c-7129-4d4f-ad68-8edc2f075b36" containerID="928a354fc3c6c124382298d730fde8ab0d9196457642cfcacd698e46a2f50409" exitCode=60
Oct 30 21:00:07.020910 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:07.020798    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv" event={"ID":"bca6091c-7129-4d4f-ad68-8edc2f075b36","Type":"ContainerDied","Data":"928a354fc3c6c124382298d730fde8ab0d9196457642cfcacd698e46a2f50409"}
Oct 30 21:00:07.021161 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:07.021145    4948 scope.go:122] "RemoveContainer" containerID="928a354fc3c6c124382298d730fde8ab0d9196457642cfcacd698e46a2f50409"
Oct 30 21:00:07.021558 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:00:07.021520    4948 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv_odh-ai-gateway-infra(bca6091c-7129-4d4f-ad68-8edc2f075b36)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv" podUID="bca6091c-7129-4d4f-ad68-8edc2f075b36"
Oct 30 21:00:07.032321 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:07.032296    4948 scope.go:122] "RemoveContainer" containerID="3101e9e4da80af9aba0fcf9a85e5241ca84d83f726f58ab451bcb10c8b70d624"
Oct 30 21:00:07.088462 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:07.088425    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:08.039403 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.039331    4948 scope.go:122] "RemoveContainer" containerID="5ac0a9e3c5850c6c53bd33c802ffd7bad3a89ef02a24e13501d2c015bba86202"
Oct 30 21:00:08.040407 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:00:08.040351    4948 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv_odh-ai-gateway-infra(1d5e5f59-44ec-40aa-844b-04481d593661)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv" podUID="1d5e5f59-44ec-40aa-844b-04481d593661"
Oct 30 21:00:08.055418 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.043022    4948 scope.go:122] "RemoveContainer" containerID="928a354fc3c6c124382298d730fde8ab0d9196457642cfcacd698e46a2f50409"
Oct 30 21:00:08.055418 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:00:08.043448    4948 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv_odh-ai-gateway-infra(bca6091c-7129-4d4f-ad68-8edc2f075b36)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv" podUID="bca6091c-7129-4d4f-ad68-8edc2f075b36"
Oct 30 21:00:08.116388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.109325    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:08.592414 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.587760    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:08.639388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.637652    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"]
Oct 30 21:00:08.646384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.644691    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"]
Oct 30 21:00:08.646384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.644804    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.655385 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.653566    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-4a0c5b\"/\"distinct-w0-4a0c5b-kserve-self-signed-certs\""
Oct 30 21:00:08.655385 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.653649    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-4a0c5b\"/\"default-dockercfg-46tcm\""
Oct 30 21:00:08.655385 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.653663    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-4a0c5b\"/\"kube-root-ca.crt\""
Oct 30 21:00:08.655385 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.653722    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-4a0c5b\"/\"openshift-service-ca.crt\""
Oct 30 21:00:08.787387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.779200    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3cad62a-1e45-4f57-98d0-6388c59c0be6-tls-certs\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.787387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.779296    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btq7f\" (UniqueName: \"kubernetes.io/projected/c3cad62a-1e45-4f57-98d0-6388c59c0be6-kube-api-access-btq7f\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.787387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.779331    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-home\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.787387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.779404    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-model-cache\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.787387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.779520    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-tmp-dir\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.787387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.779630    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-dshm\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.884455 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.884148    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-tmp-dir\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.884455 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.884282    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-dshm\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.884455 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.884341    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3cad62a-1e45-4f57-98d0-6388c59c0be6-tls-certs\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.884455 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.884428    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btq7f\" (UniqueName: \"kubernetes.io/projected/c3cad62a-1e45-4f57-98d0-6388c59c0be6-kube-api-access-btq7f\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.884864 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.884474    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-home\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.884864 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.884546    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-model-cache\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.888385 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.885119    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-model-cache\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.888385 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.885431    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-tmp-dir\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.888385 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.886461    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-home\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.928388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.921140    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3cad62a-1e45-4f57-98d0-6388c59c0be6-tls-certs\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.929407 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.929352    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btq7f\" (UniqueName: \"kubernetes.io/projected/c3cad62a-1e45-4f57-98d0-6388c59c0be6-kube-api-access-btq7f\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:08.939414 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:08.936874    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-dshm\") pod \"distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:09.075386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.074678    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:09.446995 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.446966    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"]
Oct 30 21:00:09.448389 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:00:09.448326    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3cad62a_1e45_4f57_98d0_6388c59c0be6.slice/crio-7c0f245e9e94562875bbc1c74669ae8afcb71518b176a743355699b0f2d47d41 WatchSource:0}: Error finding container 7c0f245e9e94562875bbc1c74669ae8afcb71518b176a743355699b0f2d47d41: Status 404 returned error can't find the container with id 7c0f245e9e94562875bbc1c74669ae8afcb71518b176a743355699b0f2d47d41
Oct 30 21:00:09.494142 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.494105    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:09.634839 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.634789    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"]
Oct 30 21:00:09.640158 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.640124    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.653595 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.653552    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"]
Oct 30 21:00:09.707574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.707529    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzqtx\" (UniqueName: \"kubernetes.io/projected/f3258410-eddc-4436-bbf8-73042e516c88-kube-api-access-mzqtx\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.707574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.707576    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3258410-eddc-4436-bbf8-73042e516c88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.707851 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.707619    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.707851 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.707683    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.707851 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.707718    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.707851 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.707748    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.707851 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.707791    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.707851 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.707846    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3258410-eddc-4436-bbf8-73042e516c88-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.708152 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.707907    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3258410-eddc-4436-bbf8-73042e516c88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.809679 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.809574    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.809679 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.809637    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.809679 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.809672    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.810002 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.809716    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.810002 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.809770    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3258410-eddc-4436-bbf8-73042e516c88-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.810002 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.809838    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3258410-eddc-4436-bbf8-73042e516c88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.810002 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.809953    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzqtx\" (UniqueName: \"kubernetes.io/projected/f3258410-eddc-4436-bbf8-73042e516c88-kube-api-access-mzqtx\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.810002 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.809983    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3258410-eddc-4436-bbf8-73042e516c88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.810274 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.810033    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.810274 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.810064    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.810479 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.810456    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.810543 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.810477    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.810724 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.810702    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.811164 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.811138    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3258410-eddc-4436-bbf8-73042e516c88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.817080 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.816994    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3258410-eddc-4436-bbf8-73042e516c88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.818826 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.818787    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.824344 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.824307    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3258410-eddc-4436-bbf8-73042e516c88-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.824967 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.824944    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzqtx\" (UniqueName: \"kubernetes.io/projected/f3258410-eddc-4436-bbf8-73042e516c88-kube-api-access-mzqtx\") pod \"maas-default-gateway-openshift-default-58c6585447-g6ns8\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:09.970890 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:09.970836    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:10.069475 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.067760    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" event={"ID":"c3cad62a-1e45-4f57-98d0-6388c59c0be6","Type":"ContainerStarted","Data":"02bc100868f6898fff251f47aef0aea25322602950b9d2a0ae0fdcde0839d13c"}
Oct 30 21:00:10.069475 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.067816    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" event={"ID":"c3cad62a-1e45-4f57-98d0-6388c59c0be6","Type":"ContainerStarted","Data":"7c0f245e9e94562875bbc1c74669ae8afcb71518b176a743355699b0f2d47d41"}
Oct 30 21:00:10.077402 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.076188    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:10.097306 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.097227    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podStartSLOduration=2.097204976 podStartE2EDuration="2.097204976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:10.096335966 +0000 UTC m=+1277.915847953" watchObservedRunningTime="2026-10-30 21:00:10.097204976 +0000 UTC m=+1277.916716966"
Oct 30 21:00:10.303987 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:00:10.301262    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3258410_eddc_4436_bbf8_73042e516c88.slice/crio-7cf81f76856b41fdcf858d73e499b39d7f27c0a2aea5ba7f6390f1a1e2c6b577 WatchSource:0}: Error finding container 7cf81f76856b41fdcf858d73e499b39d7f27c0a2aea5ba7f6390f1a1e2c6b577: Status 404 returned error can't find the container with id 7cf81f76856b41fdcf858d73e499b39d7f27c0a2aea5ba7f6390f1a1e2c6b577
Oct 30 21:00:10.304857 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.304806    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:10.305004 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.304906    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:10.305004 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.304948    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:10.305533 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.305502    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"]
Oct 30 21:00:10.561821 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.561765    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"]
Oct 30 21:00:10.571993 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.568882    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.609327 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.609294    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"]
Oct 30 21:00:10.626600 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.626557    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.626826 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.626727    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.626897 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.626854    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.626958 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.626907    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c9c8245-6152-4562-88da-2264625bc3da-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.626958 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.626937    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qtrv\" (UniqueName: \"kubernetes.io/projected/8c9c8245-6152-4562-88da-2264625bc3da-kube-api-access-5qtrv\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.627081 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.627052    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c9c8245-6152-4562-88da-2264625bc3da-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.627151 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.627103    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.627200 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.627164    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.627266 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.627252    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c9c8245-6152-4562-88da-2264625bc3da-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.731155 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.731119    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c9c8245-6152-4562-88da-2264625bc3da-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.731461 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.731422    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c9c8245-6152-4562-88da-2264625bc3da-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.731636 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.731619    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qtrv\" (UniqueName: \"kubernetes.io/projected/8c9c8245-6152-4562-88da-2264625bc3da-kube-api-access-5qtrv\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.732161 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.732135    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c9c8245-6152-4562-88da-2264625bc3da-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.732643 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.732625    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.733577 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.733174    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.733817 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.733104    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.734119 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.734102    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c9c8245-6152-4562-88da-2264625bc3da-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.734887 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.734865    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.735401 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.735287    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.735851 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.735831    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.735992 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.735974    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.736223 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.736204    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.737259 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.736730    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.740763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.740700    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c9c8245-6152-4562-88da-2264625bc3da-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.749721 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.748463    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.787739 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.787661    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c9c8245-6152-4562-88da-2264625bc3da-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.789289 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.789254    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qtrv\" (UniqueName: \"kubernetes.io/projected/8c9c8245-6152-4562-88da-2264625bc3da-kube-api-access-5qtrv\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:10.867969 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.867818    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:10.906328 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:10.906290    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:11.040815 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.040709    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"]
Oct 30 21:00:11.046542 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.046509    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.058846 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.058804    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"]
Oct 30 21:00:11.080172 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.080131    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8" event={"ID":"f3258410-eddc-4436-bbf8-73042e516c88","Type":"ContainerStarted","Data":"e78755941921f5522c99272b195da86d01869af8720ad12284e8001f0dc2ca47"}
Oct 30 21:00:11.089415 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.080183    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8" event={"ID":"f3258410-eddc-4436-bbf8-73042e516c88","Type":"ContainerStarted","Data":"7cf81f76856b41fdcf858d73e499b39d7f27c0a2aea5ba7f6390f1a1e2c6b577"}
Oct 30 21:00:11.143507 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.143398    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.143507 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.143439    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.143713 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.143559    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gqk5\" (UniqueName: \"kubernetes.io/projected/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-kube-api-access-2gqk5\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.143713 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.143617    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.143713 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.143649    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.143713 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.143677    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.143843 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.143832    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.143880 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.143859    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.143955 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.143941    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.206681 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.206612    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8" podStartSLOduration=2.206593632 podStartE2EDuration="2.206593632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:11.113308104 +0000 UTC m=+1278.932820093" watchObservedRunningTime="2026-10-30 21:00:11.206593632 +0000 UTC m=+1279.026105625"
Oct 30 21:00:11.207797 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.207767    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"]
Oct 30 21:00:11.209276 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:00:11.209247    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c9c8245_6152_4562_88da_2264625bc3da.slice/crio-6260dc17651922db1ae25c5c56a491d3816ef588bedd42a739df230a748623b7 WatchSource:0}: Error finding container 6260dc17651922db1ae25c5c56a491d3816ef588bedd42a739df230a748623b7: Status 404 returned error can't find the container with id 6260dc17651922db1ae25c5c56a491d3816ef588bedd42a739df230a748623b7
Oct 30 21:00:11.212224 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.212189    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:11.212298 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.212265    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:11.212298 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.212295    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:11.245230 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.245186    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.245230 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.245234    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.245546 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.245300    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.245546 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.245432    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.245546 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.245458    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.245703 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.245540    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gqk5\" (UniqueName: \"kubernetes.io/projected/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-kube-api-access-2gqk5\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.245703 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.245587    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.245703 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.245620    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.245703 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.245666    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.245901 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.245809    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.246353 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.246012    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.246353 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.246100    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.246353 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.246187    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.246616 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.246466    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.247964 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.247940    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.248120 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.248103    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.276392 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.275824    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gqk5\" (UniqueName: \"kubernetes.io/projected/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-kube-api-access-2gqk5\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.278975 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.278937    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.380388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.378743    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:11.697959 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.697930    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"]
Oct 30 21:00:11.699404 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:00:11.699372    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ad7e60_0b7c_4c4b_9ca1_73d89b00ff54.slice/crio-1b06aa1a64493a9293f1a83c434dcb93ffeec4fa0bd9d433e7f893c34d61a88d WatchSource:0}: Error finding container 1b06aa1a64493a9293f1a83c434dcb93ffeec4fa0bd9d433e7f893c34d61a88d: Status 404 returned error can't find the container with id 1b06aa1a64493a9293f1a83c434dcb93ffeec4fa0bd9d433e7f893c34d61a88d
Oct 30 21:00:11.702525 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.702487    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:11.702624 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.702567    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:11.702624 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.702600    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:11.824039 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.823992    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:11.989819 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.989233    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:11.989819 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.989399    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-g6ns8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 21:00:11.989819 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:11.989447    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8" podUID="f3258410-eddc-4436-bbf8-73042e516c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 21:00:12.133647 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:12.133594    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj" event={"ID":"8c9c8245-6152-4562-88da-2264625bc3da","Type":"ContainerStarted","Data":"875431c5182aeb00c0329a86a60565dfec90d547dc8c96c51d0e94d65cf39502"}
Oct 30 21:00:12.134175 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:12.133673    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj" event={"ID":"8c9c8245-6152-4562-88da-2264625bc3da","Type":"ContainerStarted","Data":"6260dc17651922db1ae25c5c56a491d3816ef588bedd42a739df230a748623b7"}
Oct 30 21:00:12.138232 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:12.138120    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f" event={"ID":"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54","Type":"ContainerStarted","Data":"954929a629d4f1a2d36bae649812c5ba0b454c46552e898e67aef9223c7e86bc"}
Oct 30 21:00:12.138232 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:12.138189    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f" event={"ID":"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54","Type":"ContainerStarted","Data":"1b06aa1a64493a9293f1a83c434dcb93ffeec4fa0bd9d433e7f893c34d61a88d"}
Oct 30 21:00:12.217387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:12.207107    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj" podStartSLOduration=2.207083404 podStartE2EDuration="2.207083404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:12.170896281 +0000 UTC m=+1279.990408267" watchObservedRunningTime="2026-10-30 21:00:12.207083404 +0000 UTC m=+1280.026595392"
Oct 30 21:00:12.383387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:12.382897    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:12.383387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:12.383050    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:00:12.383387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:12.383098    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f" podUID="00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 21:00:12.930751 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:12.930714    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:12.932031 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:12.931999    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:00:12.932284 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:12.932243    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj" podUID="8c9c8245-6152-4562-88da-2264625bc3da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 21:00:13.005216 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:13.005174    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-g6ns8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 21:00:13.006347 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:13.006299    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8" podUID="f3258410-eddc-4436-bbf8-73042e516c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 21:00:13.142030 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:13.141915    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:13.381419 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:13.380909    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:00:13.381419 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:13.380978    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f" podUID="00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 21:00:13.908387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:13.908218    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:00:13.908387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:13.908288    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj" podUID="8c9c8245-6152-4562-88da-2264625bc3da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 21:00:13.982387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:13.981421    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-g6ns8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 21:00:14.007386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:13.981528    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8" podUID="f3258410-eddc-4436-bbf8-73042e516c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 21:00:14.295450 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:14.289424    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:14.396403 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:14.391046    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:00:14.409436 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:14.391219    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f" podUID="00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 21:00:14.908926 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:14.908880    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:00:14.909260 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:14.909228    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj" podUID="8c9c8245-6152-4562-88da-2264625bc3da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 21:00:14.979970 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:14.979918    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-g6ns8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 21:00:14.981586 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:14.981540    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8" podUID="f3258410-eddc-4436-bbf8-73042e516c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 21:00:15.414782 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:15.413771    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:00:15.414782 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:15.413851    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f" podUID="00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 21:00:15.416635 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:15.416202    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:15.907389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:15.906918    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:00:15.907389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:15.906996    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj" podUID="8c9c8245-6152-4562-88da-2264625bc3da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 21:00:15.979763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:15.979725    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-g6ns8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 21:00:15.980087 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:15.980054    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8" podUID="f3258410-eddc-4436-bbf8-73042e516c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 21:00:16.389388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:16.388407    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:00:16.389388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:16.388475    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f" podUID="00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 21:00:16.632713 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:16.632400    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:16.911222 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:16.911183    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:00:16.911546 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:16.911502    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj" podUID="8c9c8245-6152-4562-88da-2264625bc3da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 21:00:17.026097 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:16.978906    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-g6ns8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 21:00:17.026097 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:17.025427    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8" podUID="f3258410-eddc-4436-bbf8-73042e516c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 21:00:17.425569 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:17.425521    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:00:17.427831 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:17.427783    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f" podUID="00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 21:00:17.644526 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:17.644468    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:17.907831 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:17.907793    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:00:17.908027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:17.907851    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj" podUID="8c9c8245-6152-4562-88da-2264625bc3da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 21:00:17.974890 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:17.974838    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-g6ns8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 21:00:17.975113 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:17.974913    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8" podUID="f3258410-eddc-4436-bbf8-73042e516c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 21:00:18.380303 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:18.380249    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:00:18.380713 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:18.380328    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f" podUID="00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 21:00:18.618386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:18.618302    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:18.912180 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:18.912147    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:18.912808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:18.912660    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:18.914290 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:18.914260    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:00:18.940776 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:18.940704    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f" podStartSLOduration=7.940678826 podStartE2EDuration="7.940678826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:12.205704824 +0000 UTC m=+1280.025216818" watchObservedRunningTime="2026-10-30 21:00:18.940678826 +0000 UTC m=+1286.760190815"
Oct 30 21:00:18.976196 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:18.976151    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-g6ns8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Oct 30 21:00:18.976537 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:18.976448    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8" podUID="f3258410-eddc-4436-bbf8-73042e516c88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Oct 30 21:00:19.088924 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:19.083831    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:19.120028 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:19.119995    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:19.317448 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:19.317146    4948 scope.go:122] "RemoveContainer" containerID="5ac0a9e3c5850c6c53bd33c802ffd7bad3a89ef02a24e13501d2c015bba86202"
Oct 30 21:00:19.484172 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:19.484137    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:00:19.609637 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:19.609065    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:19.611599 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:19.610717    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:19.615769 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:19.613968    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:00:19.733286 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:19.733247    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:20.214347 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:20.214252    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:20.216016 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:20.215985    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:20.216715 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:20.216693    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:00:20.287942 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:20.287911    4948 scope.go:122] "RemoveContainer" containerID="928a354fc3c6c124382298d730fde8ab0d9196457642cfcacd698e46a2f50409"
Oct 30 21:00:20.469807 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:20.468856    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv" event={"ID":"1d5e5f59-44ec-40aa-844b-04481d593661","Type":"ContainerStarted","Data":"e34437380c46d8cf038a8f5c7fefcf39c47bb2d4bfb82c016bf9644e4e6f960e"}
Oct 30 21:00:20.646400 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:20.646319    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:21.477395 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:21.477346    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:21.478787 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:21.478758    4948 generic.go:356] "Generic (PLEG): container finished" podID="1d5e5f59-44ec-40aa-844b-04481d593661" containerID="e34437380c46d8cf038a8f5c7fefcf39c47bb2d4bfb82c016bf9644e4e6f960e" exitCode=60
Oct 30 21:00:21.478919 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:21.478836    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv" event={"ID":"1d5e5f59-44ec-40aa-844b-04481d593661","Type":"ContainerDied","Data":"e34437380c46d8cf038a8f5c7fefcf39c47bb2d4bfb82c016bf9644e4e6f960e"}
Oct 30 21:00:21.478919 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:21.478907    4948 scope.go:122] "RemoveContainer" containerID="5ac0a9e3c5850c6c53bd33c802ffd7bad3a89ef02a24e13501d2c015bba86202"
Oct 30 21:00:21.479337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:21.479313    4948 scope.go:122] "RemoveContainer" containerID="e34437380c46d8cf038a8f5c7fefcf39c47bb2d4bfb82c016bf9644e4e6f960e"
Oct 30 21:00:21.479734 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:00:21.479706    4948 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv_odh-ai-gateway-infra(1d5e5f59-44ec-40aa-844b-04481d593661)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv" podUID="1d5e5f59-44ec-40aa-844b-04481d593661"
Oct 30 21:00:21.481113 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:21.481092    4948 generic.go:356] "Generic (PLEG): container finished" podID="bca6091c-7129-4d4f-ad68-8edc2f075b36" containerID="0878a2816795740148e052bb95386747d0b8eea0f216b0fb28c3e21d1dbfe50e" exitCode=60
Oct 30 21:00:21.481223 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:21.481161    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv" event={"ID":"bca6091c-7129-4d4f-ad68-8edc2f075b36","Type":"ContainerDied","Data":"0878a2816795740148e052bb95386747d0b8eea0f216b0fb28c3e21d1dbfe50e"}
Oct 30 21:00:21.481839 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:21.481822    4948 scope.go:122] "RemoveContainer" containerID="0878a2816795740148e052bb95386747d0b8eea0f216b0fb28c3e21d1dbfe50e"
Oct 30 21:00:21.482024 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:00:21.482006    4948 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv_odh-ai-gateway-infra(bca6091c-7129-4d4f-ad68-8edc2f075b36)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv" podUID="bca6091c-7129-4d4f-ad68-8edc2f075b36"
Oct 30 21:00:21.493009 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:21.492985    4948 scope.go:122] "RemoveContainer" containerID="928a354fc3c6c124382298d730fde8ab0d9196457642cfcacd698e46a2f50409"
Oct 30 21:00:21.510215 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:21.510183    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv"]
Oct 30 21:00:22.241715 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:22.241675    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:22.551869 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:22.551825    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv"]
Oct 30 21:00:22.743334 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:22.743261    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv"
Oct 30 21:00:22.765655 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:22.765619    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv"
Oct 30 21:00:22.867404 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:22.867326    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bca6091c-7129-4d4f-ad68-8edc2f075b36-kube-api-access-vhfqv\" (UniqueName: \"kubernetes.io/projected/bca6091c-7129-4d4f-ad68-8edc2f075b36-kube-api-access-vhfqv\") pod \"bca6091c-7129-4d4f-ad68-8edc2f075b36\" (UID: \"bca6091c-7129-4d4f-ad68-8edc2f075b36\") "
Oct 30 21:00:22.867594 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:22.867547    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d5e5f59-44ec-40aa-844b-04481d593661-kube-api-access-vvxdj\" (UniqueName: \"kubernetes.io/projected/1d5e5f59-44ec-40aa-844b-04481d593661-kube-api-access-vvxdj\") pod \"1d5e5f59-44ec-40aa-844b-04481d593661\" (UID: \"1d5e5f59-44ec-40aa-844b-04481d593661\") "
Oct 30 21:00:22.867654 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:22.867630    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bca6091c-7129-4d4f-ad68-8edc2f075b36-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bca6091c-7129-4d4f-ad68-8edc2f075b36-maas-api-service-ca\") pod \"bca6091c-7129-4d4f-ad68-8edc2f075b36\" (UID: \"bca6091c-7129-4d4f-ad68-8edc2f075b36\") "
Oct 30 21:00:22.867728 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:22.867680    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1d5e5f59-44ec-40aa-844b-04481d593661-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d5e5f59-44ec-40aa-844b-04481d593661-maas-api-service-ca\") pod \"1d5e5f59-44ec-40aa-844b-04481d593661\" (UID: \"1d5e5f59-44ec-40aa-844b-04481d593661\") "
Oct 30 21:00:22.868096 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:22.868064    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bca6091c-7129-4d4f-ad68-8edc2f075b36-maas-api-service-ca" pod "bca6091c-7129-4d4f-ad68-8edc2f075b36" (UID: "bca6091c-7129-4d4f-ad68-8edc2f075b36"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:22.868329 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:22.868306    4948 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bca6091c-7129-4d4f-ad68-8edc2f075b36-maas-api-service-ca\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:22.868431 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:22.868392    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d5e5f59-44ec-40aa-844b-04481d593661-maas-api-service-ca" pod "1d5e5f59-44ec-40aa-844b-04481d593661" (UID: "1d5e5f59-44ec-40aa-844b-04481d593661"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:22.870510 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:22.870478    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d5e5f59-44ec-40aa-844b-04481d593661-kube-api-access-vvxdj" pod "1d5e5f59-44ec-40aa-844b-04481d593661" (UID: "1d5e5f59-44ec-40aa-844b-04481d593661"). InnerVolumeSpecName "kube-api-access-vvxdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:22.870634 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:22.870520    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bca6091c-7129-4d4f-ad68-8edc2f075b36-kube-api-access-vhfqv" pod "bca6091c-7129-4d4f-ad68-8edc2f075b36" (UID: "bca6091c-7129-4d4f-ad68-8edc2f075b36"). InnerVolumeSpecName "kube-api-access-vhfqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:22.970156 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:22.970111    4948 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d5e5f59-44ec-40aa-844b-04481d593661-maas-api-service-ca\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:22.970156 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:22.970152    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhfqv\" (UniqueName: \"kubernetes.io/projected/bca6091c-7129-4d4f-ad68-8edc2f075b36-kube-api-access-vhfqv\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:22.970156 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:22.970164    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvxdj\" (UniqueName: \"kubernetes.io/projected/1d5e5f59-44ec-40aa-844b-04481d593661-kube-api-access-vvxdj\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:23.191816 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:23.191774    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:23.501218 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:23.501131    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv"
Oct 30 21:00:23.501218 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:23.501168    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv" event={"ID":"1d5e5f59-44ec-40aa-844b-04481d593661","Type":"ContainerDied","Data":"6002426b495777a5ccca9b73732358f7ef503b3288184c0f1b1d778ac96687df"}
Oct 30 21:00:23.501475 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:23.501247    4948 scope.go:122] "RemoveContainer" containerID="e34437380c46d8cf038a8f5c7fefcf39c47bb2d4bfb82c016bf9644e4e6f960e"
Oct 30 21:00:23.502923 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:23.502892    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv" event={"ID":"bca6091c-7129-4d4f-ad68-8edc2f075b36","Type":"ContainerDied","Data":"1610fa01ecd645a8a257f3bc6bb1a3b48a6e5cf492300f22bf462b7068c3662f"}
Oct 30 21:00:23.503043 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:23.502954    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv"
Oct 30 21:00:23.516745 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:23.516721    4948 scope.go:122] "RemoveContainer" containerID="0878a2816795740148e052bb95386747d0b8eea0f216b0fb28c3e21d1dbfe50e"
Oct 30 21:00:23.541741 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:23.541695    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv"]
Oct 30 21:00:23.548335 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:23.548287    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-5a8f94-29889900-sxjcv"]
Oct 30 21:00:23.563118 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:23.563081    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv"]
Oct 30 21:00:23.569191 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:23.569156    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-32a969-29889900-lhbfv"]
Oct 30 21:00:23.914315 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:23.914275    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:23.936132 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:00:23.936088    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:00:24.300633 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.300525    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1d5e5f59-44ec-40aa-844b-04481d593661" path="/var/lib/kubelet/pods/1d5e5f59-44ec-40aa-844b-04481d593661/volumes"
Oct 30 21:00:24.301058 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.301042    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bca6091c-7129-4d4f-ad68-8edc2f075b36" path="/var/lib/kubelet/pods/bca6091c-7129-4d4f-ad68-8edc2f075b36/volumes"
Oct 30 21:00:24.703842 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.703540    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:24.749580 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.749510    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"]
Oct 30 21:00:24.750403 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.750330    4948 cpu_manager.go:414] "containerMap: removing container" podUID="bca6091c-7129-4d4f-ad68-8edc2f075b36" containerName="cleanup"
Oct 30 21:00:24.750403 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.750404    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bca6091c-7129-4d4f-ad68-8edc2f075b36" containerName="cleanup"
Oct 30 21:00:24.751821 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.750421    4948 cpu_manager.go:414] "containerMap: removing container" podUID="bca6091c-7129-4d4f-ad68-8edc2f075b36" containerName="cleanup"
Oct 30 21:00:24.751821 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.750429    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bca6091c-7129-4d4f-ad68-8edc2f075b36" containerName="cleanup"
Oct 30 21:00:24.751821 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.750454    4948 cpu_manager.go:414] "containerMap: removing container" podUID="bca6091c-7129-4d4f-ad68-8edc2f075b36" containerName="cleanup"
Oct 30 21:00:24.751821 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.750463    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bca6091c-7129-4d4f-ad68-8edc2f075b36" containerName="cleanup"
Oct 30 21:00:24.751821 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.750474    4948 cpu_manager.go:414] "containerMap: removing container" podUID="1d5e5f59-44ec-40aa-844b-04481d593661" containerName="cleanup"
Oct 30 21:00:24.751821 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.750481    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d5e5f59-44ec-40aa-844b-04481d593661" containerName="cleanup"
Oct 30 21:00:24.751821 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.750537    4948 cpu_manager.go:414] "containerMap: removing container" podUID="1d5e5f59-44ec-40aa-844b-04481d593661" containerName="cleanup"
Oct 30 21:00:24.751821 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.750545    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d5e5f59-44ec-40aa-844b-04481d593661" containerName="cleanup"
Oct 30 21:00:24.751821 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.750697    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d5e5f59-44ec-40aa-844b-04481d593661" containerName="cleanup"
Oct 30 21:00:24.751821 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.750709    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d5e5f59-44ec-40aa-844b-04481d593661" containerName="cleanup"
Oct 30 21:00:24.751821 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.750722    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="bca6091c-7129-4d4f-ad68-8edc2f075b36" containerName="cleanup"
Oct 30 21:00:24.751821 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.750729    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="bca6091c-7129-4d4f-ad68-8edc2f075b36" containerName="cleanup"
Oct 30 21:00:24.751821 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.750739    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="bca6091c-7129-4d4f-ad68-8edc2f075b36" containerName="cleanup"
Oct 30 21:00:24.756150 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.756125    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:24.762023 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.761985    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"]
Oct 30 21:00:24.766352 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.764653    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-39fb96\"/\"distinct-2-w6-39fb96-kserve-self-signed-certs\""
Oct 30 21:00:24.906250 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.906205    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-model-cache\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:24.906611 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.906584    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxct2\" (UniqueName: \"kubernetes.io/projected/130c8e9f-87a1-4e95-a656-a6c7f65bf509-kube-api-access-vxct2\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:24.906831 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.906800    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-home\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:24.907001 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.906975    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/130c8e9f-87a1-4e95-a656-a6c7f65bf509-tls-certs\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:24.907323 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.907286    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-tmp-dir\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:24.907611 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.907590    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-dshm\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:24.941349 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:24.941304    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:25.009557 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.009458    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-dshm\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:25.009557 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.009520    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-model-cache\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:25.009793 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.009579    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxct2\" (UniqueName: \"kubernetes.io/projected/130c8e9f-87a1-4e95-a656-a6c7f65bf509-kube-api-access-vxct2\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:25.009793 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.009615    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-home\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:25.009793 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.009655    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/130c8e9f-87a1-4e95-a656-a6c7f65bf509-tls-certs\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:25.009793 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.009759    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-tmp-dir\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:25.010007 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.009942    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-model-cache\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:25.010066 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.010030    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-home\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:25.010149 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.010128    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-tmp-dir\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:25.011978 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.011953    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-dshm\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:25.012262 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.012240    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/130c8e9f-87a1-4e95-a656-a6c7f65bf509-tls-certs\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:25.025649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.025613    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxct2\" (UniqueName: \"kubernetes.io/projected/130c8e9f-87a1-4e95-a656-a6c7f65bf509-kube-api-access-vxct2\") pod \"distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") " pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:25.076730 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.076689    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:25.366108 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.366070    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"]
Oct 30 21:00:25.367782 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:00:25.367750    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod130c8e9f_87a1_4e95_a656_a6c7f65bf509.slice/crio-5168c78ae87606b25d255030b88d536e94b33e9a6bfcd5e5731352792d0d5c26 WatchSource:0}: Error finding container 5168c78ae87606b25d255030b88d536e94b33e9a6bfcd5e5731352792d0d5c26: Status 404 returned error can't find the container with id 5168c78ae87606b25d255030b88d536e94b33e9a6bfcd5e5731352792d0d5c26
Oct 30 21:00:25.521075 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.521034    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" event={"ID":"130c8e9f-87a1-4e95-a656-a6c7f65bf509","Type":"ContainerStarted","Data":"e71615238f0c13c5a61b8c0f1a5df6681434821f0026beff12831438a0049dc7"}
Oct 30 21:00:25.521241 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.521086    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" event={"ID":"130c8e9f-87a1-4e95-a656-a6c7f65bf509","Type":"ContainerStarted","Data":"5168c78ae87606b25d255030b88d536e94b33e9a6bfcd5e5731352792d0d5c26"}
Oct 30 21:00:25.543048 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.542988    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podStartSLOduration=1.5429699719999999 podStartE2EDuration="1.542969972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:25.539743975 +0000 UTC m=+1293.359255961" watchObservedRunningTime="2026-10-30 21:00:25.542969972 +0000 UTC m=+1293.362481959"
Oct 30 21:00:25.646881 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.646769    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:25.765690 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.765653    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"]
Oct 30 21:00:25.766304 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.766289    4948 cpu_manager.go:414] "containerMap: removing container" podUID="1d5e5f59-44ec-40aa-844b-04481d593661" containerName="cleanup"
Oct 30 21:00:25.766346 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.766305    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d5e5f59-44ec-40aa-844b-04481d593661" containerName="cleanup"
Oct 30 21:00:25.766419 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.766409    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d5e5f59-44ec-40aa-844b-04481d593661" containerName="cleanup"
Oct 30 21:00:25.770148 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.770122    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:25.784088 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.784055    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"]
Oct 30 21:00:25.922436 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.922279    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7123b746-4253-4381-8585-b0090b9fbb22-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:25.922436 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.922353    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:25.922670 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.922517    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7123b746-4253-4381-8585-b0090b9fbb22-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:25.922670 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.922549    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hpt9\" (UniqueName: \"kubernetes.io/projected/7123b746-4253-4381-8585-b0090b9fbb22-kube-api-access-7hpt9\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:25.922670 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.922624    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7123b746-4253-4381-8585-b0090b9fbb22-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:25.922670 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.922664    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:25.922796 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.922699    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:25.922796 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.922745    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:25.922796 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:25.922775    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.024192 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.024151    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7123b746-4253-4381-8585-b0090b9fbb22-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.024425 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.024236    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.024425 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.024307    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7123b746-4253-4381-8585-b0090b9fbb22-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.024425 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.024332    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hpt9\" (UniqueName: \"kubernetes.io/projected/7123b746-4253-4381-8585-b0090b9fbb22-kube-api-access-7hpt9\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.024425 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.024383    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7123b746-4253-4381-8585-b0090b9fbb22-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.024689 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.024450    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.024689 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.024494    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.024689 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.024543    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.024689 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.024648    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.024898 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.024797    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.024898 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.024830    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.025205 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.025182    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7123b746-4253-4381-8585-b0090b9fbb22-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.025323 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.025305    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.025402 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.025378    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.026945 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.026913    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.027115 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.027089    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7123b746-4253-4381-8585-b0090b9fbb22-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.037921 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.037881    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7123b746-4253-4381-8585-b0090b9fbb22-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.038193 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.038171    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hpt9\" (UniqueName: \"kubernetes.io/projected/7123b746-4253-4381-8585-b0090b9fbb22-kube-api-access-7hpt9\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.077032 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.076995    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:26.086368 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.086319    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:26.557995 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.557956    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"]
Oct 30 21:00:26.560168 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:00:26.560134    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7123b746_4253_4381_8585_b0090b9fbb22.slice/crio-1f0ae5de14f8a24a0365b1c385afaafed45f24b87554cb3e0fa605855f25bb52 WatchSource:0}: Error finding container 1f0ae5de14f8a24a0365b1c385afaafed45f24b87554cb3e0fa605855f25bb52: Status 404 returned error can't find the container with id 1f0ae5de14f8a24a0365b1c385afaafed45f24b87554cb3e0fa605855f25bb52
Oct 30 21:00:26.564842 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.564790    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:26.564977 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.564899    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:26.564977 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.564951    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:26.707470 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:26.707419    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:27.647388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:27.633785    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr" event={"ID":"7123b746-4253-4381-8585-b0090b9fbb22","Type":"ContainerStarted","Data":"8b64def5a3755becf1835bc708c3e7b1af4b8e3f32622256c7792e0be5aca8ec"}
Oct 30 21:00:27.655558 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:27.655502    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr" event={"ID":"7123b746-4253-4381-8585-b0090b9fbb22","Type":"ContainerStarted","Data":"1f0ae5de14f8a24a0365b1c385afaafed45f24b87554cb3e0fa605855f25bb52"}
Oct 30 21:00:27.735390 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:27.724850    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr" podStartSLOduration=2.724827241 podStartE2EDuration="2.724827241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:27.698468227 +0000 UTC m=+1295.517980217" watchObservedRunningTime="2026-10-30 21:00:27.724827241 +0000 UTC m=+1295.544339253"
Oct 30 21:00:28.121454 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:28.105444    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:28.121454 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:28.105587    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 21:00:28.121454 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:28.105645    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr" podUID="7123b746-4253-4381-8585-b0090b9fbb22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 21:00:28.780383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:28.779546    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:00:28.780383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:28.779642    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw" podUID="77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:28.804540 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:28.804470    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:28.953635 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:28.953572    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:28.962055 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:28.962014    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:29.088893 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:29.088852    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 21:00:29.089168 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:29.089138    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr" podUID="7123b746-4253-4381-8585-b0090b9fbb22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 21:00:29.905087 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:29.905046    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:30.087229 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:30.087190    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 21:00:30.087439 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:30.087257    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr" podUID="7123b746-4253-4381-8585-b0090b9fbb22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 21:00:30.713109 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:30.713068    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:31.087125 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:31.087090    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 21:00:31.087670 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:31.087150    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr" podUID="7123b746-4253-4381-8585-b0090b9fbb22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 21:00:31.600073 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:31.600037    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:32.087180 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:32.087140    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 21:00:32.087668 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:32.087203    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr" podUID="7123b746-4253-4381-8585-b0090b9fbb22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 21:00:32.427437 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:32.413188    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:33.087238 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:33.087187    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 21:00:33.087727 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:33.087285    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr" podUID="7123b746-4253-4381-8585-b0090b9fbb22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 21:00:33.437159 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:33.437060    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:33.652547 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:33.652197    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:34.087767 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:34.087730    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 21:00:34.088263 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:34.087797    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr" podUID="7123b746-4253-4381-8585-b0090b9fbb22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 21:00:34.236295 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:34.236219    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:35.080529 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:35.079804    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:35.098090 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:35.097921    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:35.112224 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:35.112183    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:35.378997 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:35.378958    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:35.379436 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:35.379416    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:35.380313 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:35.380290    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:00:35.770410 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:35.770289    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:36.019426 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:36.019380    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:37.106401 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:37.106279    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:37.552355 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:37.549557    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:38.590147 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:38.590059    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:39.403561 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:39.403501    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:39.693584 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:39.693493    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:40.202698 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:40.202655    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:40.894398 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:40.894327    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:41.025133 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.025087    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"]
Oct 30 21:00:41.034420 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.034349    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.046880 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.046834    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"]
Oct 30 21:00:41.107170 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.107124    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-credential-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.107411 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.107270    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/009d223b-94e0-474f-9588-ef9cab2530ff-istio-token\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.107411 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.107310    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-workload-certs\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.107411 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.107404    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-istio-data\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.107548 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.107490    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-istio-envoy\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.107548 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.107517    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/009d223b-94e0-474f-9588-ef9cab2530ff-istio-podinfo\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.107624 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.107614    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgt2c\" (UniqueName: \"kubernetes.io/projected/009d223b-94e0-474f-9588-ef9cab2530ff-kube-api-access-zgt2c\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.107662 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.107653    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-workload-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.107711 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.107687    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/009d223b-94e0-474f-9588-ef9cab2530ff-istiod-ca-cert\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.209539 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.209413    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-istio-envoy\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.209539 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.209481    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/009d223b-94e0-474f-9588-ef9cab2530ff-istio-podinfo\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.209539 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.209521    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgt2c\" (UniqueName: \"kubernetes.io/projected/009d223b-94e0-474f-9588-ef9cab2530ff-kube-api-access-zgt2c\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.209888 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.209556    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-workload-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.209888 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.209579    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/009d223b-94e0-474f-9588-ef9cab2530ff-istiod-ca-cert\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.209888 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.209661    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-credential-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.209888 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.209732    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/009d223b-94e0-474f-9588-ef9cab2530ff-istio-token\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.209888 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.209770    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-workload-certs\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.209888 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.209827    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-istio-data\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.210174 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.210028    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-workload-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.210174 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.210072    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-credential-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.210506 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.210484    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-workload-certs\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.210554 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.210505    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/009d223b-94e0-474f-9588-ef9cab2530ff-istiod-ca-cert\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.210592 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.210574    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-istio-data\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.211994 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.211967    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-istio-envoy\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.212265 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.212246    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/009d223b-94e0-474f-9588-ef9cab2530ff-istio-podinfo\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.222665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.222627    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/009d223b-94e0-474f-9588-ef9cab2530ff-istio-token\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.222828 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.222705    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgt2c\" (UniqueName: \"kubernetes.io/projected/009d223b-94e0-474f-9588-ef9cab2530ff-kube-api-access-zgt2c\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.371702 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.371655    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:41.673461 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.673427    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"]
Oct 30 21:00:41.675121 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:00:41.675087    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009d223b_94e0_474f_9588_ef9cab2530ff.slice/crio-c942697c41502f8d615ecdf794dae9d1fdb2ca3fe0575a917673e02d04ecbedd WatchSource:0}: Error finding container c942697c41502f8d615ecdf794dae9d1fdb2ca3fe0575a917673e02d04ecbedd: Status 404 returned error can't find the container with id c942697c41502f8d615ecdf794dae9d1fdb2ca3fe0575a917673e02d04ecbedd
Oct 30 21:00:41.678278 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.678232    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:41.678407 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.678333    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:41.678460 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.678417    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:41.752832 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.752792    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:41.844434 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.844385    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65" event={"ID":"009d223b-94e0-474f-9588-ef9cab2530ff","Type":"ContainerStarted","Data":"bc6f197547ae103cf5a215e3f5ecd6b23b588ec05af3a8ff1ff6c6e591bdab1d"}
Oct 30 21:00:41.844664 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.844463    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65" event={"ID":"009d223b-94e0-474f-9588-ef9cab2530ff","Type":"ContainerStarted","Data":"c942697c41502f8d615ecdf794dae9d1fdb2ca3fe0575a917673e02d04ecbedd"}
Oct 30 21:00:41.873594 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:41.873529    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65" podStartSLOduration=0.873504824 podStartE2EDuration="873.504824ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:41.871333502 +0000 UTC m=+1309.690845491" watchObservedRunningTime="2026-10-30 21:00:41.873504824 +0000 UTC m=+1309.693016816"
Oct 30 21:00:42.374908 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:42.374868    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:42.376894 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:42.376866    4948 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 21:00:42.377068 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:42.376928    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65" podUID="009d223b-94e0-474f-9588-ef9cab2530ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 21:00:42.505656 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:42.505520    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:43.379384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:43.379184    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:43.379915 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:43.379651    4948 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 21:00:43.379915 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:43.379707    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65" podUID="009d223b-94e0-474f-9588-ef9cab2530ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 21:00:43.809819 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:43.809725    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:44.260403 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:44.256483    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:44.382764 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:44.382715    4948 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 21:00:44.383243 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:44.382782    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65" podUID="009d223b-94e0-474f-9588-ef9cab2530ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 21:00:44.545452 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:44.541382    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:45.276386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:45.276172    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:45.374906 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:45.374862    4948 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 21:00:45.375104 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:45.374924    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65" podUID="009d223b-94e0-474f-9588-ef9cab2530ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 21:00:46.123384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:46.122721    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:46.374982 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:46.374875    4948 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 21:00:46.375161 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:46.375053    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65" podUID="009d223b-94e0-474f-9588-ef9cab2530ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 21:00:46.946081 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:46.946030    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:47.375023 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:47.374974    4948 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 21:00:47.375611 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:47.375466    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65" podUID="009d223b-94e0-474f-9588-ef9cab2530ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 21:00:47.701951 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:47.701707    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:48.025509 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:48.025409    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:48.233282 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:48.233234    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:48.374432 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:48.374345    4948 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 21:00:48.374633 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:48.374500    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65" podUID="009d223b-94e0-474f-9588-ef9cab2530ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 21:00:48.511274 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:48.511220    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:48.792448 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:48.792029    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"]
Oct 30 21:00:48.846006 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:48.845961    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:48.867111 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:48.867076    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:48.869091 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:48.869018    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"]
Oct 30 21:00:48.986705 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:48.986673    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-65968b\"/\"kube-root-ca.crt\""
Oct 30 21:00:48.987117 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:48.987099    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-65968b\"/\"default-dockercfg-xrc8s\""
Oct 30 21:00:48.992395 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:48.987305    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-65968b\"/\"distinct-w5-65968b-kserve-self-signed-certs\""
Oct 30 21:00:48.998137 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:48.988338    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-65968b\"/\"openshift-service-ca.crt\""
Oct 30 21:00:49.028773 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.028731    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-home\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.029119 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.029092    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d85be7b-dc46-49ad-b587-6dba0ce67823-tls-certs\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.029405 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.029381    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-dshm\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.029593 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.029569    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsw54\" (UniqueName: \"kubernetes.io/projected/4d85be7b-dc46-49ad-b587-6dba0ce67823-kube-api-access-rsw54\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.029804 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.029783    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-model-cache\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.035019 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.034977    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-tmp-dir\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.136798 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.136746    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-home\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.137035 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.136818    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d85be7b-dc46-49ad-b587-6dba0ce67823-tls-certs\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.137035 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.136882    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-dshm\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.137035 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.136917    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsw54\" (UniqueName: \"kubernetes.io/projected/4d85be7b-dc46-49ad-b587-6dba0ce67823-kube-api-access-rsw54\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.137035 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.136994    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-model-cache\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.137295 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.137054    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-tmp-dir\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.137295 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.137255    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-home\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.137480 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.137439    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-model-cache\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.137546 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.137488    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-tmp-dir\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.139623 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.139596    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d85be7b-dc46-49ad-b587-6dba0ce67823-tls-certs\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.139782 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.139697    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-dshm\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.154790 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.154746    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsw54\" (UniqueName: \"kubernetes.io/projected/4d85be7b-dc46-49ad-b587-6dba0ce67823-kube-api-access-rsw54\") pod \"distinct-w5-65968b-kserve-5985d9f696-5dh6q\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") " pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:49.356388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:49.353656    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:50.199712 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:50.199625    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:50.425233 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:50.423000    4948 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:00:50.425233 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:50.423077    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65" podUID="009d223b-94e0-474f-9588-ef9cab2530ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:50.536387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:50.513652    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"]
Oct 30 21:00:50.800031 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:50.798590    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:50.899441 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:50.898540    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:51.216811 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:51.216777    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:51.219107 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:51.219078    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:51.227609 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:51.227579    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:00:51.527388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:51.526396    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" event={"ID":"4d85be7b-dc46-49ad-b587-6dba0ce67823","Type":"ContainerStarted","Data":"7c79edaad15ee603070ceb3ba68dbf169df0cde942ca5f2e570c2ff1678932ee"}
Oct 30 21:00:51.917480 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:51.917445    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:52.533872 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:52.533816    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" event={"ID":"4d85be7b-dc46-49ad-b587-6dba0ce67823","Type":"ContainerStarted","Data":"1663631f478a23d018345e34e7efe42cae08366a710ff9d2345a7a1763f46d0f"}
Oct 30 21:00:52.559564 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:52.559494    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podStartSLOduration=4.559477011 podStartE2EDuration="4.559477011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:52.555996666 +0000 UTC m=+1320.375508655" watchObservedRunningTime="2026-10-30 21:00:52.559477011 +0000 UTC m=+1320.378988996"
Oct 30 21:00:52.791489 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:52.790399    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:53.354676 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:53.354631    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:53.642442 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:53.642074    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:53.848063 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:53.848025    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:53.930826 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:00:53.930729    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:00:54.308624 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:54.308502    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:55.122075 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.122025    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:55.388594 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.388476    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"]
Oct 30 21:00:55.395006 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.394975    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.412052 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.412007    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"]
Oct 30 21:00:55.422091 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.422052    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.422284 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.422247    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.422345 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.422287    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.422425 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.422385    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.422483 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.422445    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.422550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.422534    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.422605 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.422564    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.422647 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.422633    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvv67\" (UniqueName: \"kubernetes.io/projected/0141b4ff-f223-4fed-be7e-16f2e33ec90a-kube-api-access-rvv67\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.422758 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.422742    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.480083 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.480039    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"]
Oct 30 21:00:55.484709 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.484684    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.499551 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.499517    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"]
Oct 30 21:00:55.533651 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.533406    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fngl\" (UniqueName: \"kubernetes.io/projected/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-kube-api-access-9fngl\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.533651 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.533481    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.533651 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.533536    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.533945 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.533803    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.533945 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.533918    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.534044 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.534026    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.534123 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.534091    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.534209 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.534184    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.534269 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.534223    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.534269 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.534261    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.534347 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.534304    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.534508 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.534484    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.534602 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.534567    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.534670 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.534634    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.534727 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.534689    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.534780 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.534740    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.534780 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.534774    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.534880 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.534802    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.534880 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.534834    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvv67\" (UniqueName: \"kubernetes.io/projected/0141b4ff-f223-4fed-be7e-16f2e33ec90a-kube-api-access-rvv67\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.534979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.534885    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.535032 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.535003    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.536586 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.536535    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.536731 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.536690    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.537611 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.537584    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.537933 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.537911    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.550489 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.550449    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.550669 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.550517    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvv67\" (UniqueName: \"kubernetes.io/projected/0141b4ff-f223-4fed-be7e-16f2e33ec90a-kube-api-access-rvv67\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.639314 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.639187    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fngl\" (UniqueName: \"kubernetes.io/projected/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-kube-api-access-9fngl\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.639314 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.639253    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.639314 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.639301    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.639673 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.639445    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.639673 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.639497    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.639673 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.639519    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.639673 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.639556    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.639673 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.639627    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.639931 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.639698    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.640110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.640083    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.641209 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.640355    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.641209 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.640690    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.641209 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.640933    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.641209 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.641166    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.642743 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.642714    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.643676 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.643646    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.645685 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.645653    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"]
Oct 30 21:00:55.654211 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.654159    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"]
Oct 30 21:00:55.654493 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.654171    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.659878 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.659848    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.662838 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.662748    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fngl\" (UniqueName: \"kubernetes.io/projected/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-kube-api-access-9fngl\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.718076 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.718038    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:55.741263 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.741217    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.741465 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.741288    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.741518 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.741498    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.741572 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.741558    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.741660 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.741636    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.741719 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.741690    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.741774 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.741734    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.741812 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.741794    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.741927 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.741912    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7bhq\" (UniqueName: \"kubernetes.io/projected/f77b2b95-869a-4e6b-96e1-ce1382ec7896-kube-api-access-k7bhq\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.802041 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.801995    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:55.843571 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.843532    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.843761 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.843598    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.843761 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.843619    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.843761 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.843639    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.843761 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.843663    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.843761 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.843686    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.843761 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.843728    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7bhq\" (UniqueName: \"kubernetes.io/projected/f77b2b95-869a-4e6b-96e1-ce1382ec7896-kube-api-access-k7bhq\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.844103 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.843772    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.844103 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.843831    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.844103 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.844046    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.844257 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.844175    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.844339 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.844313    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.844687 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.844662    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.844785 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.844768    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.849412 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.847067    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.850119 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.850081    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.877753 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.877640    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.878542 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.878502    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7bhq\" (UniqueName: \"kubernetes.io/projected/f77b2b95-869a-4e6b-96e1-ce1382ec7896-kube-api-access-k7bhq\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:55.892969 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.892928    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"]
Oct 30 21:00:55.899282 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.899245    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:55.912301 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.911503    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"]
Oct 30 21:00:55.949411 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.948409    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:55.949411 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.948523    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zftwt\" (UniqueName: \"kubernetes.io/projected/755c4a92-3dbc-4c53-9c9e-3092071391cd-kube-api-access-zftwt\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:55.949411 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.948690    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/755c4a92-3dbc-4c53-9c9e-3092071391cd-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:55.949411 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.948743    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:55.949411 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.948880    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:55.949411 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.948928    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:55.949411 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.949001    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:55.949411 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.949072    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:55.949411 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:55.949117    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.009665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.009619    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:56.040964 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.040905    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:56.041114 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.041015    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:56.041114 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.041057    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:56.042629 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.042494    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"]
Oct 30 21:00:56.050743 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.050697    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.050910 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.050752    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.050910 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.050788    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.050910 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.050830    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.050910 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.050868    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.051156 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.050992    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.051156 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.051057    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zftwt\" (UniqueName: \"kubernetes.io/projected/755c4a92-3dbc-4c53-9c9e-3092071391cd-kube-api-access-zftwt\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.051156 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.051130    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.051316 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.051192    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.051449 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.051132    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/755c4a92-3dbc-4c53-9c9e-3092071391cd-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.051515 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.051470    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.051515 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.051499    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.051701 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.051662    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.051822 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.051798    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/755c4a92-3dbc-4c53-9c9e-3092071391cd-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.054074 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.054048    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.055496 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.055473    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.068841 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.068808    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.069049 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.069021    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zftwt\" (UniqueName: \"kubernetes.io/projected/755c4a92-3dbc-4c53-9c9e-3092071391cd-kube-api-access-zftwt\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.133321 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.133281    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"]
Oct 30 21:00:56.220426 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.160655    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:56.220426 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.160769    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:56.220426 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.160819    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:56.237327 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.234707    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:56.297651 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.297596    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:56.345311 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.345269    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"]
Oct 30 21:00:56.381498 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.380953    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:56.381498 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.381049    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:56.381498 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.381102    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:56.580142 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.580089    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"]
Oct 30 21:00:56.583487 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.583431    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t" event={"ID":"0141b4ff-f223-4fed-be7e-16f2e33ec90a","Type":"ContainerStarted","Data":"2d548f4f8e36775ea6db120634ebd0db0b831a7375fe668f016681a15a909f7e"}
Oct 30 21:00:56.583678 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.583509    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t" event={"ID":"0141b4ff-f223-4fed-be7e-16f2e33ec90a","Type":"ContainerStarted","Data":"91768b17653c386652247fbe7e1079c3ec51e5324bbb17fd741bc3cb09ffb6c0"}
Oct 30 21:00:56.586298 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.586264    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" event={"ID":"f77b2b95-869a-4e6b-96e1-ce1382ec7896","Type":"ContainerStarted","Data":"0468cca518a63997ca3c2309b100c3b1dec0d022f5d5c315a6178bdeaa39b50e"}
Oct 30 21:00:56.586298 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.586327    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" event={"ID":"f77b2b95-869a-4e6b-96e1-ce1382ec7896","Type":"ContainerStarted","Data":"341023548d18a4502bb54cca4683e5a5052834fd93b7e33eca6cc0c689587b8a"}
Oct 30 21:00:56.592471 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.592204    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr" event={"ID":"17f8a1bb-f09d-4a66-97eb-242dd0261f2b","Type":"ContainerStarted","Data":"a26d38f6d1ef34a427533c125f61a7ec2814b3ee228a15bec390cafe0035a1b4"}
Oct 30 21:00:56.592471 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.592273    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr" event={"ID":"17f8a1bb-f09d-4a66-97eb-242dd0261f2b","Type":"ContainerStarted","Data":"f829abdaed928b358711fc3ba5a775b830b733cdf89ed50f29eafd3ef1a8344a"}
Oct 30 21:00:56.599341 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.599246    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:56.599604 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.599395    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:56.599604 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.599476    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:00:56.640252 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.640178    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" podStartSLOduration=1.6401579819999998 podStartE2EDuration="1.640157982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:56.638913027 +0000 UTC m=+1324.458425028" watchObservedRunningTime="2026-10-30 21:00:56.640157982 +0000 UTC m=+1324.459669976"
Oct 30 21:00:56.642253 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.642197    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t" podStartSLOduration=1.642181565 podStartE2EDuration="1.642181565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:56.608458988 +0000 UTC m=+1324.427970974" watchObservedRunningTime="2026-10-30 21:00:56.642181565 +0000 UTC m=+1324.461693551"
Oct 30 21:00:56.674325 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.674229    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr" podStartSLOduration=1.6742028549999999 podStartE2EDuration="1.674202855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:56.670219075 +0000 UTC m=+1324.489731062" watchObservedRunningTime="2026-10-30 21:00:56.674202855 +0000 UTC m=+1324.493714871"
Oct 30 21:00:56.719662 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.718489    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:00:56.802909 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:56.802831    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:00:57.049295 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:57.048988    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:00:57.070407 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:57.061515    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:00:57.084391 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:57.074453    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" podUID="f77b2b95-869a-4e6b-96e1-ce1382ec7896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:00:57.363439 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:57.363402    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:57.639451 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:57.636671    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4" event={"ID":"755c4a92-3dbc-4c53-9c9e-3092071391cd","Type":"ContainerStarted","Data":"f307609e370e2f5cda52a890095b23cead1cad1ce04dcf26b1b5150d203e5bc9"}
Oct 30 21:00:57.639451 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:57.636748    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4" event={"ID":"755c4a92-3dbc-4c53-9c9e-3092071391cd","Type":"ContainerStarted","Data":"930b1e3c7c2fc06bb4b283484f507f29d7fde0420d43ec6686ab144a83cd9813"}
Oct 30 21:00:57.820384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:57.797614    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:00:57.820384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:57.797702    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t" podUID="0141b4ff-f223-4fed-be7e-16f2e33ec90a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:00:57.820384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:57.813496    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:00:57.820384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:57.813580    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr" podUID="17f8a1bb-f09d-4a66-97eb-242dd0261f2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:00:58.021515 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:58.018338    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:00:58.021515 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:58.018424    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" podUID="f77b2b95-869a-4e6b-96e1-ce1382ec7896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:00:58.251703 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:58.251564    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:00:58.256944 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:58.256494    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:00:58.256944 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:58.256600    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4" podUID="755c4a92-3dbc-4c53-9c9e-3092071391cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:00:58.740384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:58.738157    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:00:58.740384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:58.738253    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t" podUID="0141b4ff-f223-4fed-be7e-16f2e33ec90a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:00:58.763388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:58.757442    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:00:58.808908 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:58.808827    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:00:58.808908 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:58.808899    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr" podUID="17f8a1bb-f09d-4a66-97eb-242dd0261f2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:00:58.809197 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:58.809054    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:00:58.930388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:58.928479    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:59.011705 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:59.011573    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:59.013133 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:59.013103    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:00:59.014162 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:59.014129    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" podUID="f77b2b95-869a-4e6b-96e1-ce1382ec7896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:00:59.243006 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:59.242955    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:00:59.286616 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:59.270478    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4" podUID="755c4a92-3dbc-4c53-9c9e-3092071391cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:00:59.403419 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:59.397633    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:00:59.466030 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:59.464479    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Oct 30 21:00:59.781724 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:59.758023    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:00:59.781724 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:59.758088    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t" podUID="0141b4ff-f223-4fed-be7e-16f2e33ec90a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:00:59.781724 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:59.758528    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:59.781724 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:59.758939    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:00:59.887412 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:59.876069    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:00:59.887412 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:59.876828    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:00:59.887412 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:59.876872    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr" podUID="17f8a1bb-f09d-4a66-97eb-242dd0261f2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:01:00.003783 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:59.955627    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:00.003783 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:00:59.956094    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 21:01:00.125459 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.015295    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4" podStartSLOduration=5.015270466 podStartE2EDuration="5.015270466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:57.825597678 +0000 UTC m=+1325.645109669" watchObservedRunningTime="2026-10-30 21:01:00.015270466 +0000 UTC m=+1327.834782454"
Oct 30 21:01:00.197060 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.196998    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:00.236739 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.236699    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 21:01:00.384453 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.316524    4948 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/health\": context deadline exceeded"
Oct 30 21:01:00.384453 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.325665    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:01:00.384453 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.327047    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4" podUID="755c4a92-3dbc-4c53-9c9e-3092071391cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:01:00.386252 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.325718    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:01:00.386471 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.386286    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" podUID="f77b2b95-869a-4e6b-96e1-ce1382ec7896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:01:00.482394 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.476483    4948 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:00.486481 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.485220    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Oct 30 21:01:00.837984 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.837943    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:00.867521 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.867464    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:01:00.989386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.959462    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr" podUID="17f8a1bb-f09d-4a66-97eb-242dd0261f2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:01:00.989386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.908228    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:00.989386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.973534    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:01:00.989386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.973603    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t" podUID="0141b4ff-f223-4fed-be7e-16f2e33ec90a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:01:00.989386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.959327    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:00.989386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.911280    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:01:00.989386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.975329    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 21:01:00.989386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:00.867998    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:01.026405 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:01.010259    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:01:01.026405 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:01.010331    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" podUID="f77b2b95-869a-4e6b-96e1-ce1382ec7896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:01:01.209543 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:01.209422    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:01.248395 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:01.237224    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:01:01.271960 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:01.259824    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4" podUID="755c4a92-3dbc-4c53-9c9e-3092071391cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:01:01.497478 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:01.487085    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:01.734411 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:01.734371    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:01:01.734758 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:01.734719    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t" podUID="0141b4ff-f223-4fed-be7e-16f2e33ec90a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:01:01.804450 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:01.804042    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:01:01.804450 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:01.804108    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr" podUID="17f8a1bb-f09d-4a66-97eb-242dd0261f2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:01:02.014384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:01.994636    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:01:02.014384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:01.995088    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:02.014384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:01.996727    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 21:01:02.065541 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:02.065431    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:02.093744 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:02.093701    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:01:02.094083 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:02.094037    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" podUID="f77b2b95-869a-4e6b-96e1-ce1382ec7896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:01:02.450664 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:02.450597    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:01:02.459541 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:02.459455    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4" podUID="755c4a92-3dbc-4c53-9c9e-3092071391cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:01:02.562536 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:02.545008    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:02.760449 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:02.714185    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:02.848390 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:02.833105    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:01:02.884433 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:02.865158    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t" podUID="0141b4ff-f223-4fed-be7e-16f2e33ec90a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:01:03.092332 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.092286    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:01:03.093044 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.092997    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" podUID="f77b2b95-869a-4e6b-96e1-ce1382ec7896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:01:03.094237 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.094212    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:01:03.117471 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.115406    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr" podUID="17f8a1bb-f09d-4a66-97eb-242dd0261f2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:01:03.221014 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.218618    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:03.242906 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.242836    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 21:01:03.246626 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.246564    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:03.358600 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.358481    4948 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:03.484643 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.484593    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:01:03.484948 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.484915    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4" podUID="755c4a92-3dbc-4c53-9c9e-3092071391cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:01:03.508504 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.508420    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:03.550579 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.550520    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:03.739595 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:01:03.726658    4948 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.436s"
Oct 30 21:01:03.739595 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.726787    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"]
Oct 30 21:01:03.800436 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.799629    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": context deadline exceeded"
Oct 30 21:01:03.824557 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.808942    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"]
Oct 30 21:01:03.828617 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.826525    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:03.903987 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.882972    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:01:03.903987 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.883042    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr" podUID="17f8a1bb-f09d-4a66-97eb-242dd0261f2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:01:03.903987 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.901552    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-c2d1eb\"/\"default-dockercfg-mhxkm\""
Oct 30 21:01:03.903987 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.901705    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-c2d1eb\"/\"distinct-2-w4-c2d1eb-kserve-self-signed-certs\""
Oct 30 21:01:03.903987 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.901799    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-c2d1eb\"/\"kube-root-ca.crt\""
Oct 30 21:01:03.903987 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.901894    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-c2d1eb\"/\"openshift-service-ca.crt\""
Oct 30 21:01:03.945785 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.945727    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-tmp-dir\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:03.983789 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.962419    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-home\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:03.983789 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.962509    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-dshm\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:03.983789 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.962764    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-model-cache\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:03.983789 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.962800    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/315d7349-10f7-4c92-a563-b71f12c4f702-tls-certs\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:03.983789 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.962826    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc2bx\" (UniqueName: \"kubernetes.io/projected/315d7349-10f7-4c92-a563-b71f12c4f702-kube-api-access-wc2bx\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:03.983789 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.963158    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:01:03.983789 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.963211    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t" podUID="0141b4ff-f223-4fed-be7e-16f2e33ec90a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:01:03.983789 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:03.964084    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:04.064637 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.064500    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-model-cache\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:04.129483 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.065207    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/315d7349-10f7-4c92-a563-b71f12c4f702-tls-certs\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:04.129483 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.065244    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc2bx\" (UniqueName: \"kubernetes.io/projected/315d7349-10f7-4c92-a563-b71f12c4f702-kube-api-access-wc2bx\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:04.129483 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.065165    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:01:04.129483 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.065472    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-tmp-dir\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:04.129483 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.065486    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" podUID="f77b2b95-869a-4e6b-96e1-ce1382ec7896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:01:04.129483 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.065505    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-home\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:04.129483 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.065587    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-dshm\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:04.129483 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.065777    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-home\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:04.129483 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.065071    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-model-cache\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:04.129483 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.092918    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-tmp-dir\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:04.129483 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.104869    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-dshm\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:04.312935 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.296947    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 21:01:04.333743 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.302910    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:04.333743 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.319975    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:01:04.333743 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.328524    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4" podUID="755c4a92-3dbc-4c53-9c9e-3092071391cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:01:04.542237 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.542190    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:04.571145 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.570462    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/315d7349-10f7-4c92-a563-b71f12c4f702-tls-certs\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:04.619629 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.619376    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:01:04.648718 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.648683    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 21:01:04.648983 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.646690    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc2bx\" (UniqueName: \"kubernetes.io/projected/315d7349-10f7-4c92-a563-b71f12c4f702-kube-api-access-wc2bx\") pod \"distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:04.724389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.722232    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:04.728610 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.728558    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:01:04.728826 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.728638    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t" podUID="0141b4ff-f223-4fed-be7e-16f2e33ec90a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:01:04.827060 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.827008    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:01:04.827387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.827342    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr" podUID="17f8a1bb-f09d-4a66-97eb-242dd0261f2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:01:04.892448 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.892335    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:01:04.923946 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.923915    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 21:01:04.925853 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:04.925815    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 21:01:05.020451 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:05.019767    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:01:05.059188 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:05.044436    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" podUID="f77b2b95-869a-4e6b-96e1-ce1382ec7896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:01:05.291471 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:05.290005    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:01:05.291471 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:05.290069    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4" podUID="755c4a92-3dbc-4c53-9c9e-3092071391cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 21:01:05.353400 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:05.320670    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"]
Oct 30 21:01:05.354768 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:05.345818    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:05.418419 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:01:05.392803    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod315d7349_10f7_4c92_a563_b71f12c4f702.slice/crio-03354a39d81ae8deeb53723f8615bffc6717e25a43ef317e740edbfdad9dfabd WatchSource:0}: Error finding container 03354a39d81ae8deeb53723f8615bffc6717e25a43ef317e740edbfdad9dfabd: Status 404 returned error can't find the container with id 03354a39d81ae8deeb53723f8615bffc6717e25a43ef317e740edbfdad9dfabd
Oct 30 21:01:06.010909 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:06.010860    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:01:06.011148 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:06.010947    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" podUID="f77b2b95-869a-4e6b-96e1-ce1382ec7896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:01:06.131780 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:06.131739    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:01:06.138348 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:06.138312    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:01:06.139867 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:06.139835    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:01:06.161326 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:06.161209    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" event={"ID":"315d7349-10f7-4c92-a563-b71f12c4f702","Type":"ContainerStarted","Data":"7f0f96cac0802cdb19a414f8bb48f69d8968be683e334e9dd01659413bb3c1dc"}
Oct 30 21:01:06.161326 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:06.161283    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" event={"ID":"315d7349-10f7-4c92-a563-b71f12c4f702","Type":"ContainerStarted","Data":"03354a39d81ae8deeb53723f8615bffc6717e25a43ef317e740edbfdad9dfabd"}
Oct 30 21:01:06.194021 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:06.193851    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podStartSLOduration=4.19382811 podStartE2EDuration="4.19382811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:06.185331099 +0000 UTC m=+1334.004843095" watchObservedRunningTime="2026-10-30 21:01:06.19382811 +0000 UTC m=+1334.013340099"
Oct 30 21:01:06.339079 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:06.339041    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:01:06.341465 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:06.341436    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:01:06.342957 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:06.342934    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:01:06.442384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:06.441787    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:06.730001 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:06.729888    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:06.856750 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:06.856716    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:01:06.857164 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:06.857136    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:01:06.858045 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:06.858026    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:01:07.029656 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:07.029550    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:01:07.030277 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:07.030249    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:01:07.031454 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:07.031430    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:01:07.312445 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:07.311908    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:08.302214 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:08.302170    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:09.006383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:08.992913    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:09.368301 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:09.368269    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:01:09.380777 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:09.380746    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:01:09.757965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:09.757848    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:10.516043 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.515997    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:10.539735 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.539694    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"]
Oct 30 21:01:10.548730 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.548696    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"]
Oct 30 21:01:10.548941 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.548811    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.673906 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.673852    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.674234 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.674202    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.674388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.674270    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.674388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.674305    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.674388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.674382    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad516464-a895-4e85-bd16-cf9bdcedba2d-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.674577 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.674441    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.674577 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.674519    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhsdc\" (UniqueName: \"kubernetes.io/projected/ad516464-a895-4e85-bd16-cf9bdcedba2d-kube-api-access-mhsdc\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.674577 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.674548    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.674731 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.674579    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.776530 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.776425    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.776530 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.776481    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.776530 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.776527    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.776801 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.776569    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.776801 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.776613    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad516464-a895-4e85-bd16-cf9bdcedba2d-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.776801 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.776649    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.776801 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.776717    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhsdc\" (UniqueName: \"kubernetes.io/projected/ad516464-a895-4e85-bd16-cf9bdcedba2d-kube-api-access-mhsdc\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.776801 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.776749    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.776801 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.776779    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.777416 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.777388    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.777566 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.777454    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.777566 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.777523    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.777661 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.777565    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.777782 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.777763    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad516464-a895-4e85-bd16-cf9bdcedba2d-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.779500 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.779475    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.779721 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.779701    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.811453 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.811417    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.822403 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.822324    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhsdc\" (UniqueName: \"kubernetes.io/projected/ad516464-a895-4e85-bd16-cf9bdcedba2d-kube-api-access-mhsdc\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.874303 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.874265    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:10.975167 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.975101    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"]
Oct 30 21:01:10.982870 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.982841    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:10.997031 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:10.992986    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"]
Oct 30 21:01:11.070598 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.070503    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"]
Oct 30 21:01:11.075282 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.075245    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.080823 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.080784    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29bd5543-e7f6-4989-877b-47efbbc7ab19-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.080993 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.080830    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbvz9\" (UniqueName: \"kubernetes.io/projected/29bd5543-e7f6-4989-877b-47efbbc7ab19-kube-api-access-wbvz9\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.081088 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.081065    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.081184 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.081165    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.081241 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.081199    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.081338 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.081322    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.081422 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.081352    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.081479 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.081449    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.081622 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.081598    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.094858 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.094815    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"]
Oct 30 21:01:11.099975 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.099929    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"]
Oct 30 21:01:11.105772 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.105741    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.119858 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.118171    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"]
Oct 30 21:01:11.177599 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.177009    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"]
Oct 30 21:01:11.180553 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:01:11.180492    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad516464_a895_4e85_bd16_cf9bdcedba2d.slice/crio-16d382239445881f3fed6d1851169b543773c7624c5036b3219606c37b6d7578 WatchSource:0}: Error finding container 16d382239445881f3fed6d1851169b543773c7624c5036b3219606c37b6d7578: Status 404 returned error can't find the container with id 16d382239445881f3fed6d1851169b543773c7624c5036b3219606c37b6d7578
Oct 30 21:01:11.182674 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.182644    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.182800 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.182695    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.182800 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.182775    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.182909 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.182849    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.182959 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.182906    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.182959 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.182936    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29bd5543-e7f6-4989-877b-47efbbc7ab19-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.183117 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.182961    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbvz9\" (UniqueName: \"kubernetes.io/projected/29bd5543-e7f6-4989-877b-47efbbc7ab19-kube-api-access-wbvz9\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.183117 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.183035    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5bkr\" (UniqueName: \"kubernetes.io/projected/64439bcb-741d-4b5c-83c6-f04b69619331-kube-api-access-q5bkr\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.183117 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.183059    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.183117 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.183108    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.183328 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.183140    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64439bcb-741d-4b5c-83c6-f04b69619331-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.183328 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.183163    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.183328 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.183196    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.183328 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.183228    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.183328 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.183259    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.183596 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.183344    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64439bcb-741d-4b5c-83c6-f04b69619331-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.183596 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.183388    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64439bcb-741d-4b5c-83c6-f04b69619331-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.183596 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.183428    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.183838 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.183768    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:01:11.183838 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.183794    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29bd5543-e7f6-4989-877b-47efbbc7ab19-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.183838 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.183816    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.184054 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.183891    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:01:11.184054 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.183937    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:01:11.184212 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.184191    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.184960 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.184576    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.184960 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.184742    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.189732 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.189702    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.189997 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.189978    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.196826 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.196788    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbvz9\" (UniqueName: \"kubernetes.io/projected/29bd5543-e7f6-4989-877b-47efbbc7ab19-kube-api-access-wbvz9\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.197731 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.197690    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.205258 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.205226    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" event={"ID":"ad516464-a895-4e85-bd16-cf9bdcedba2d","Type":"ContainerStarted","Data":"16d382239445881f3fed6d1851169b543773c7624c5036b3219606c37b6d7578"}
Oct 30 21:01:11.284603 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.284565    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.284816 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.284698    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5bkr\" (UniqueName: \"kubernetes.io/projected/64439bcb-741d-4b5c-83c6-f04b69619331-kube-api-access-q5bkr\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.284816 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.284752    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.284816 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.284780    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64439bcb-741d-4b5c-83c6-f04b69619331-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.284816 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.284799    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.285058 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.284832    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlrl9\" (UniqueName: \"kubernetes.io/projected/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-kube-api-access-nlrl9\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.285058 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.284899    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.285058 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.285008    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64439bcb-741d-4b5c-83c6-f04b69619331-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.285058 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.285039    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64439bcb-741d-4b5c-83c6-f04b69619331-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.285303 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.285082    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.285303 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.285154    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.285303 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.285186    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.285303 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.285236    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.285303 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.285285    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.285584 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.285461    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.285584 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.285513    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.285584 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.285536    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.285737 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.285587    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.285737 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.285656    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.285838 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.285752    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64439bcb-741d-4b5c-83c6-f04b69619331-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.285838 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.285820    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.286027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.286009    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.286107 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.286092    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.288414 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.288351    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.288562 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.288419    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64439bcb-741d-4b5c-83c6-f04b69619331-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.301854 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.301434    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64439bcb-741d-4b5c-83c6-f04b69619331-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.308415 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.308379    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5bkr\" (UniqueName: \"kubernetes.io/projected/64439bcb-741d-4b5c-83c6-f04b69619331-kube-api-access-q5bkr\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.314346 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.314305    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:11.388258 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.387603    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.388258 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.387708    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.388258 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.387762    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.388258 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.387808    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.388258 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.387905    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.388258 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.388004    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.388258 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.388101    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlrl9\" (UniqueName: \"kubernetes.io/projected/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-kube-api-access-nlrl9\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.388258 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.388160    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.389217 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.389098    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.389217 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.389172    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.390863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.389801    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.390863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.390185    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.390863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.390558    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.390863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.390798    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.391468 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.391342    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.392622 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.392465    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:11.393705 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.393671    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.443297 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.443261    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.446099 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.446029    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlrl9\" (UniqueName: \"kubernetes.io/projected/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-kube-api-access-nlrl9\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.652432 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.652396    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"]
Oct 30 21:01:11.652816 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:01:11.652445    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29bd5543_e7f6_4989_877b_47efbbc7ab19.slice/crio-2322a97ea237c33b495a675d6a62bbcfc7b75216e015cfad6904a76c46e20887 WatchSource:0}: Error finding container 2322a97ea237c33b495a675d6a62bbcfc7b75216e015cfad6904a76c46e20887: Status 404 returned error can't find the container with id 2322a97ea237c33b495a675d6a62bbcfc7b75216e015cfad6904a76c46e20887
Oct 30 21:01:11.656019 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.655983    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:01:11.656113 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.656068    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:01:11.656113 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.656102    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:01:11.729889 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.729854    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:11.778409 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.778371    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"]
Oct 30 21:01:11.880977 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.880936    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:11.886451 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.886388    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:01:11.887621 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.887582    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:01:11.887857 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:11.887831    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:01:12.415111 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:12.415024    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" podStartSLOduration=2.415004093 podStartE2EDuration="2.415004093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:12.409051295 +0000 UTC m=+1340.228563284" watchObservedRunningTime="2026-10-30 21:01:12.415004093 +0000 UTC m=+1340.234516080"
Oct 30 21:01:12.518331 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:12.446127    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" podStartSLOduration=2.44610222 podStartE2EDuration="2.44610222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:12.444145708 +0000 UTC m=+1340.263657694" watchObservedRunningTime="2026-10-30 21:01:12.44610222 +0000 UTC m=+1340.265614210"
Oct 30 21:01:12.546297 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:12.546227    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw" event={"ID":"64439bcb-741d-4b5c-83c6-f04b69619331","Type":"ContainerStarted","Data":"d696c372a4fcb2f8fd2539a6c583fff9930895b75f6c2168d833dd554c3bcee0"}
Oct 30 21:01:12.549060 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:12.549009    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" event={"ID":"29bd5543-e7f6-4989-877b-47efbbc7ab19","Type":"ContainerStarted","Data":"ec49cc49b15415ea95e8977140356df3a7cabb7b12b7d97c17a6c98db43a0e2e"}
Oct 30 21:01:12.602489 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:12.585721    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" event={"ID":"29bd5543-e7f6-4989-877b-47efbbc7ab19","Type":"ContainerStarted","Data":"2322a97ea237c33b495a675d6a62bbcfc7b75216e015cfad6904a76c46e20887"}
Oct 30 21:01:12.602489 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:12.585810    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" event={"ID":"ad516464-a895-4e85-bd16-cf9bdcedba2d","Type":"ContainerStarted","Data":"389450bc2ceba606c110f277a90c9c95c898f30a85adfa028730011357421604"}
Oct 30 21:01:12.849219 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:12.849154    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:01:12.877944 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:12.877808    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:01:12.878648 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:12.878606    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:01:12.899067 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:12.877560    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:12.906311 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:12.906280    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:12.906508 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:12.906478    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:01:12.976659 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:12.973812    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"]
Oct 30 21:01:13.187535 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:13.187440    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:13.315140 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:13.315099    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:13.333830 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:13.333783    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:13.333966 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:13.333865    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:01:13.617986 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:13.616624    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw" event={"ID":"64439bcb-741d-4b5c-83c6-f04b69619331","Type":"ContainerStarted","Data":"4746de5d76e4774f6cbbbfdf3ed9fd641c11c2528f26dbae1304086efa1b91f6"}
Oct 30 21:01:13.697495 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:13.688277    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz" event={"ID":"cc641a0d-47aa-4281-a0f0-4caa99ac46ce","Type":"ContainerStarted","Data":"d9836d3f2101e428abdead672d005b4b1e85358833d462da891b440a21f19f14"}
Oct 30 21:01:13.867387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:13.861258    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw" podStartSLOduration=2.861237027 podStartE2EDuration="2.861237027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:13.859592594 +0000 UTC m=+1341.679104620" watchObservedRunningTime="2026-10-30 21:01:13.861237027 +0000 UTC m=+1341.680749017"
Oct 30 21:01:13.880718 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:13.878533    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:13.892572 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:13.892495    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:01:13.940205 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:13.940164    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:13.981933 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:13.981886    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:14.334953 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:14.334053    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 21:01:14.357846 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:14.357787    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:14.371086 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:14.369550    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded"
Oct 30 21:01:14.398291 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:14.358223    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:01:14.476387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:14.439712    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:14.476387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:14.439864    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:01:14.476387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:14.439912    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw" podUID="64439bcb-741d-4b5c-83c6-f04b69619331" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:01:14.555530 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:14.555467    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Oct 30 21:01:14.628648 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:14.628544    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:14.745930 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:14.744810    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:14.909740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:14.909183    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:14.909740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:14.909250    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:01:14.957687 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:14.957254    4948 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:14.958387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:14.958309    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:14.990424 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:14.962881    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 21:01:15.167453 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.000527    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:01:15.204629 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.010997    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:15.268395 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.206380    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 21:01:15.405951 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.405911    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:01:15.409499 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.409449    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw" podUID="64439bcb-741d-4b5c-83c6-f04b69619331" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:01:15.484994 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.411287    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:15.561387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.514831    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:01:15.562818 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.412016    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:15.563079 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.563047    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:01:15.563185 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.558823    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Oct 30 21:01:15.586440 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.569284    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:01:15.587276 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.411330    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 21:01:15.598528 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.598486    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 21:01:15.638390 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.623399    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz" event={"ID":"cc641a0d-47aa-4281-a0f0-4caa99ac46ce","Type":"ContainerStarted","Data":"6e43bd17836d9734c313ceb9840a4f539a08dc38256ef5d53d779ee3b0f99f31"}
Oct 30 21:01:15.795351 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.795254    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:15.795727 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.795690    4948 prober.go:122] "Probe failed" probeType="Startup" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:15.880344 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.877948    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:01:15.880344 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.878017    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz" podUID="cc641a0d-47aa-4281-a0f0-4caa99ac46ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:01:15.971386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.968222    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": context deadline exceeded"
Oct 30 21:01:15.997222 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:15.979465    4948 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/health\": context deadline exceeded"
Oct 30 21:01:16.016595 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:16.002014    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:16.016595 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:16.002081    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:01:16.143387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:16.142414    4948 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:16.230391 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:16.192036    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:01:16.237406 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:16.220463    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:16.337387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:16.230816    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:01:16.548451 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:16.547470    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded"
Oct 30 21:01:16.576430 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:16.319716    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:16.620446 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:16.597482    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:16.646384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:16.602912    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:16.687398 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:16.620559    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:01:16.728688 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:16.598566    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:01:16.728978 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:16.728922    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw" podUID="64439bcb-741d-4b5c-83c6-f04b69619331" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:01:17.026391 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:17.015094    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz" podStartSLOduration=6.015070944 podStartE2EDuration="6.015070944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:16.094316096 +0000 UTC m=+1343.913828085" watchObservedRunningTime="2026-10-30 21:01:17.015070944 +0000 UTC m=+1344.834582933"
Oct 30 21:01:17.157701 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:17.157640    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:17.179388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:17.162147    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:01:17.180331 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:17.033465    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:17.259579 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:17.259524    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:17.322618 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:17.322500    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 21:01:17.543387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:17.535575    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:17.543387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:17.535684    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:01:17.596391 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:01:17.592757    4948 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.254s"
Oct 30 21:01:17.671400 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:17.667872    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:17.692619 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:17.692567    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded"
Oct 30 21:01:17.695380 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:17.695314    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:17.936398 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:17.901458    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:01:17.937025 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:17.936950    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw" podUID="64439bcb-741d-4b5c-83c6-f04b69619331" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:01:17.948457 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:17.948407    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:17.976927 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:17.976875    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:01:18.003523 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:18.003461    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz" podUID="cc641a0d-47aa-4281-a0f0-4caa99ac46ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:01:18.163621 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:18.163567    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:18.164167 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:18.163678    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:01:18.227705 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:18.227559    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:18.453389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:18.330233    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:18.453389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:18.373162    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:01:18.453389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:18.335574    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:18.453389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:18.334451    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:18.488445 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:18.486933    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:01:18.488445 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:18.487004    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw" podUID="64439bcb-741d-4b5c-83c6-f04b69619331" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:01:18.729385 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:18.690459    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:18.807455 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:18.695203    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:18.808921 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:18.769448    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:18.809701 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:18.770223    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:01:18.813568 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:18.813509    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz" podUID="cc641a0d-47aa-4281-a0f0-4caa99ac46ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:01:18.909390 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:18.905612    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:18.909390 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:18.905684    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:01:19.372388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:19.354516    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:19.372388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:19.354589    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:01:19.386388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:19.376576    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:01:19.392434 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:19.390540    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:19.393220 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:19.393098    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:01:19.393220 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:19.393162    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw" podUID="64439bcb-741d-4b5c-83c6-f04b69619331" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:01:19.426450 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:19.425524    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": context deadline exceeded"
Oct 30 21:01:19.578386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:19.556307    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:19.752529 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:19.744870    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:01:19.752529 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:19.744936    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz" podUID="cc641a0d-47aa-4281-a0f0-4caa99ac46ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:01:19.784216 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:19.784168    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:19.821202 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:19.821143    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 21:01:19.868577 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:19.868522    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:19.887540 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:19.887499    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:19.887838 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:19.887809    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:01:20.076619 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:20.076476    4948 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:20.320868 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:20.320820    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:20.321189 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:20.321149    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:01:20.375403 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:20.368929    4948 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:20.395443 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:20.383607    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:20.402469 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:20.402424    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:01:20.402766 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:20.402734    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw" podUID="64439bcb-741d-4b5c-83c6-f04b69619331" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:01:20.403324 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:20.403294    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:20.428574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:20.428505    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:20.756983 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:20.756874    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:01:20.759625 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:20.759581    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz" podUID="cc641a0d-47aa-4281-a0f0-4caa99ac46ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:01:20.793210 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:20.793161    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:20.824020 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:20.823962    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 21:01:20.876386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:20.875924    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:20.880386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:20.878835    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:20.880386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:20.878912    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:01:21.326386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:21.325888    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:21.326386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:21.325958    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:01:21.389104 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:21.389049    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:01:21.413388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:21.400867    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:01:21.413764 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:21.413719    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw" podUID="64439bcb-741d-4b5c-83c6-f04b69619331" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:01:21.430388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:21.430314    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:21.431211 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:21.431174    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:21.732934 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:21.732889    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:01:21.733227 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:21.733192    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz" podUID="cc641a0d-47aa-4281-a0f0-4caa99ac46ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:01:21.822427 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:21.809325    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:21.828554 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:21.828482    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:21.881505 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:21.881446    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:21.901966 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:21.901915    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:21.902306 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:21.902259    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:01:21.950145 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:21.950105    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:22.355387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:22.354609    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:22.355387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:22.354679    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:01:22.406537 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:22.406483    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:22.437288 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:22.437249    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:01:22.437608 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:22.437576    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw" podUID="64439bcb-741d-4b5c-83c6-f04b69619331" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:01:22.438383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:22.438333    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:22.438881 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:22.438850    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 21:01:22.778464 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:22.777568    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:01:22.778464 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:22.777680    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz" podUID="cc641a0d-47aa-4281-a0f0-4caa99ac46ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:01:22.813968 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:22.813920    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:22.874927 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:22.874872    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:22.875264 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:22.875228    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:01:22.885310 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:22.883628    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:22.907601 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:22.907541    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:22.974567 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:22.974517    4948 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:23.314980 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:23.314935    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:23.315318 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:23.315282    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:01:23.347028 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:23.346983    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:01:23.414601 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:23.414544    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:01:23.415282 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:23.415227    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw" podUID="64439bcb-741d-4b5c-83c6-f04b69619331" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:01:23.455413 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:23.447965    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:23.455413 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:23.448546    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": context deadline exceeded"
Oct 30 21:01:23.727245 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:23.724897    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:01:23.737017 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:23.736553    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:01:23.737017 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:23.736619    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz" podUID="cc641a0d-47aa-4281-a0f0-4caa99ac46ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:01:23.770932 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:23.770896    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 21:01:23.792110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:23.789216    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 21:01:23.824006 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:23.823974    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:01:23.846664 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:23.846632    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 21:01:23.848904 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:23.825835    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:23.980999 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:01:23.980898    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:01:24.318448 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:24.318227    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:24.318448 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:24.318331    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:01:24.393836 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:24.393790    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:01:24.393836 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:24.393864    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw" podUID="64439bcb-741d-4b5c-83c6-f04b69619331" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:01:24.734387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:24.733711    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:01:24.734387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:24.733790    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz" podUID="cc641a0d-47aa-4281-a0f0-4caa99ac46ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:01:24.858377 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:24.858313    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:24.923236 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:24.922505    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:01:24.923236 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:24.922585    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:24.972222 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:24.971688    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:25.067356 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:25.055915    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:25.423991 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:25.423950    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:25.429414 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:25.429374    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:25.433490 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:25.433451    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:01:25.445026 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:25.444989    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:25.445865 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:25.445836    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:25.447834 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:25.447796    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:01:25.741687 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:25.741588    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:25.743072 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:25.743040    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:25.743852 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:25.743831    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:01:25.846661 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:25.846627    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:25.849291 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:25.849002    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:25.850022 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:25.850001    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:01:26.109784 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:26.109748    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:26.990383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:26.990212    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:27.941434 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:27.937580    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:28.720387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:28.719019    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:29.672396 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:29.665693    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:30.592780 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:30.592737    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:32.376388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:32.363496    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:33.376262 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:33.375540    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:33.410536 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:33.410484    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:33.411942 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:33.411912    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 21:01:33.579804 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:33.579752    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:33.684455 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:33.648397    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Oct 30 21:01:33.815528 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:33.795755    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:33.903421 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:33.877458    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:34.017453 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:34.016338    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:34.398395 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:34.397636    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:01:34.412446 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:34.411321    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 21:01:34.599454 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:34.598540    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:34.689485 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:34.649922    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:34.716826 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:34.711016    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:01:34.716826 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:34.711129    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:01:34.716826 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:34.711171    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:01:34.863388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:34.862676    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 21:01:34.896396 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:34.873048    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 21:01:35.164389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:35.123202    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 30 21:01:35.233786 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:35.172895    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:01:35.234147 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:35.234110    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj" podUID="8c9c8245-6152-4562-88da-2264625bc3da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:35.234325 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:35.173195    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:01:35.234501 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:35.234481    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr" podUID="17307650-956b-4f4c-be36-cbfdf82feb0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:35.255646 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:35.255594    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:35.288391 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:35.263333    4948 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:35.457458 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:35.437028    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:35.573546 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:35.573468    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": context deadline exceeded"
Oct 30 21:01:35.601548 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:35.601482    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:35.609394 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:35.608536    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 21:01:35.667399 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:35.629371    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:01:35.667399 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:35.629442    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw" podUID="ec5914af-5cdd-425a-a0d3-9b6ba2947947" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:35.693988 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:35.693935    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:35.739457 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:35.713928    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:01:35.758856 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:35.735738    4948 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/health\": context deadline exceeded"
Oct 30 21:01:35.789391 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:35.760273    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k" podUID="4c7b1669-f714-4c25-bef4-1435e11b31fd" containerName="main" probeResult="failure" output="Get \"https://10.132.0.42:8000/ready\": context deadline exceeded"
Oct 30 21:01:36.274008 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:36.273958    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 30 21:01:36.454193 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:36.446434    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:36.454193 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:36.447947    4948 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/health\": context deadline exceeded"
Oct 30 21:01:36.484310 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:36.484099    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 21:01:36.594246 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:36.582661    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": context deadline exceeded"
Oct 30 21:01:36.594246 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:36.584139    4948 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/health\": context deadline exceeded"
Oct 30 21:01:36.672571 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:36.672522    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded"
Oct 30 21:01:36.719429 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:36.688679    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:01:36.774429 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:36.773771    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr" podUID="7123b746-4253-4381-8585-b0090b9fbb22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:36.774429 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:36.699568    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:36.774429 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:36.698537    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:37.273569 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:37.273497    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:01:37.302388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:37.290060    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:37.304646 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:37.281610    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd" podUID="86a4c2e8-bcd1-4b05-89f8-a968f0d4addc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.43:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:37.331448 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:37.322771    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:37.447542 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:37.447477    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:37.555943 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:37.554413    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:37.585390 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:37.584616    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:37.639890 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:01:37.639827    4948 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.348s"
Oct 30 21:01:37.640246 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:37.640207    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:01:37.679481 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:37.677979    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:37.709091 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:37.708922    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:01:37.709091 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:37.709001    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr" podUID="17f8a1bb-f09d-4a66-97eb-242dd0261f2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:37.775312 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:37.775253    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:38.146682 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:38.146645    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 21:01:38.170180 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:38.170150    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 21:01:38.412350 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:38.412254    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 21:01:38.414238 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:38.414201    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:01:38.421575 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:38.420475    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:01:38.444386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:38.439674    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:01:39.974819 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:39.974777    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:40.182273 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:40.182234    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:40.646352 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:40.646312    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:41.582384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:41.582049    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:42.470434 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:42.470395    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:43.011750 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:43.011691    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:43.672386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:43.657561    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:43.924588 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:43.924459    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:44.482345 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:44.482301    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:45.235122 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:45.235077    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:45.987969 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:45.987924    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:46.984383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:46.981557    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:47.681687 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:47.681643    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:47.869795 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:47.869752    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"]
Oct 30 21:01:47.878764 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:47.878728    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"]
Oct 30 21:01:47.907809 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:47.907768    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"]
Oct 30 21:01:48.143569 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:48.143528    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:48.669386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:48.668588    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:49.535882 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:49.535844    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:50.373453 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:50.373355    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:51.075872 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:51.075835    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:51.797901 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:51.797856    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:52.696978 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:52.696933    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:53.407062 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:53.407014    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:53.611020 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:53.610977    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:53.940292 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:01:53.940249    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:01:54.042727 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:54.042686    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:54.717828 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:54.717781    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:55.562549 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.562502    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:55.600285 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.600243    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"]
Oct 30 21:01:55.609573 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.609540    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.627414 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.627349    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"]
Oct 30 21:01:55.712794 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.712755    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.712990 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.712887    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.712990 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.712994    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.713190 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.713043    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.713308 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.713271    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqndf\" (UniqueName: \"kubernetes.io/projected/a93ec255-05ea-4e2e-945b-f5f360aea5cf-kube-api-access-qqndf\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.713465 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.713335    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.713465 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.713405    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.713590 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.713561    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.713725 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.713696    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.815662 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.815555    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.815662 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.815654    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.815920 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.815728    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.815920 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.815770    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.815920 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.815857    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqndf\" (UniqueName: \"kubernetes.io/projected/a93ec255-05ea-4e2e-945b-f5f360aea5cf-kube-api-access-qqndf\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.815920 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.815893    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.815920 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.815916    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.816190 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.815953    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.816190 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.816022    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.816299 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.816201    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.816299 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.816248    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.816556 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.816534    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.816634 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.816558    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.816747 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.816726    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.818561 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.818537    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.818788 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.818771    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.837515 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.837476    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.837686 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.837538    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqndf\" (UniqueName: \"kubernetes.io/projected/a93ec255-05ea-4e2e-945b-f5f360aea5cf-kube-api-access-qqndf\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:55.934950 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:55.934911    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:56.239315 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:56.239278    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"]
Oct 30 21:01:56.240162 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:01:56.240133    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda93ec255_05ea_4e2e_945b_f5f360aea5cf.slice/crio-de36ae9b50ec764809a88456a1c872857c85afe9724274ee181fff19ee2f1162 WatchSource:0}: Error finding container de36ae9b50ec764809a88456a1c872857c85afe9724274ee181fff19ee2f1162: Status 404 returned error can't find the container with id de36ae9b50ec764809a88456a1c872857c85afe9724274ee181fff19ee2f1162
Oct 30 21:01:56.243254 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:56.243215    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:01:56.243353 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:56.243291    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:01:56.243353 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:56.243329    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:01:56.862006 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:56.861960    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" event={"ID":"a93ec255-05ea-4e2e-945b-f5f360aea5cf","Type":"ContainerStarted","Data":"9751b31383c92566d508e92f39e2c89e5f70fd3246382f73ff7506b077f44a89"}
Oct 30 21:01:56.862469 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:56.862021    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" event={"ID":"a93ec255-05ea-4e2e-945b-f5f360aea5cf","Type":"ContainerStarted","Data":"de36ae9b50ec764809a88456a1c872857c85afe9724274ee181fff19ee2f1162"}
Oct 30 21:01:56.891942 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:56.891875    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podStartSLOduration=1.891856378 podStartE2EDuration="1.891856378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:56.890189574 +0000 UTC m=+1384.709701563" watchObservedRunningTime="2026-10-30 21:01:56.891856378 +0000 UTC m=+1384.711368366"
Oct 30 21:01:56.937393 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:56.936779    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:01:57.010399 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:57.010142    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:57.937800 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:57.937760    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:01:57.938223 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:57.937827    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:01:58.137383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:58.134715    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:58.944581 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:58.944007    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:01:58.944581 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:58.944078    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:01:59.336445 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:59.331538    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:59.336445 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:59.332199    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:01:59.430399 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:59.428536    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:59.580590 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:59.566727    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 21:01:59.664171 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:59.664055    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded"
Oct 30 21:01:59.692839 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:59.692780    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": context deadline exceeded"
Oct 30 21:01:59.848407 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:59.817599    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:59.863554 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:59.853955    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:01:59.948791 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:59.948690    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:01:59.950473 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:01:59.950429    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:02:00.093521 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:00.093465    4948 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/health\": context deadline exceeded"
Oct 30 21:02:00.350421 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:00.348702    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 30 21:02:00.350421 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:00.349107    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:00.371286 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:00.364496    4948 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:00.424404 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:00.423981    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:02:00.424404 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:00.424060    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:02:00.448389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:00.435613    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:00.458386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:00.449130    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 21:02:00.735043 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:00.734932    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 21:02:00.828383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:00.779459    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": context deadline exceeded"
Oct 30 21:02:00.841433 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:00.782503    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded"
Oct 30 21:02:00.841433 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:00.828183    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:01.004782 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:01.004671    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 21:02:01.020049 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:01.019998    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:02:01.075387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:01.073674    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:02:01.075387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:01.073767    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 21:02:01.075387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:01.075090    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:02:01.075387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:01.075148    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:02:01.397384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:01.396849    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:01.470388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:01.464219    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 30 21:02:01.553389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:01.524160    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:01.856385 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:01.844415    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 21:02:01.995844 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:01.984108    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:02:01.995844 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:01.984182    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:02:02.027403 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:02.025889    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:02.042550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:02.042472    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Oct 30 21:02:02.043290 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:02.043256    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded"
Oct 30 21:02:02.413707 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:02.413632    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:02.600843 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:02.600795    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:02.602382 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:02.602322    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:02.848711 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:02.848652    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:02.913781 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:02.913716    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" containerID="cri-o://e71615238f0c13c5a61b8c0f1a5df6681434821f0026beff12831438a0049dc7" gracePeriod=45
Oct 30 21:02:02.938117 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:02.938057    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:02:02.943400 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:02.938445    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:02:02.969686 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:02.969593    4948 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:03.006464 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:03.006405    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" containerID="cri-o://24bc7217a6025469c4ec903b45bb44741a51e812b41b36cdadb6596b87ad2fad" gracePeriod=45
Oct 30 21:02:03.006921 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:03.006880    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" containerID="cri-o://8de156dc54e012b6a86c53948b785e20c8945068ef2df75de95bf0604ab56f4d" gracePeriod=45
Oct 30 21:02:03.064794 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:03.064647    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded"
Oct 30 21:02:03.091458 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:03.091016    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Oct 30 21:02:03.091926 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:03.091648    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:03.415391 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:03.414470    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:02:03.518625 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:03.518514    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:03.518902 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:03.518868    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z" podUID="a33086b6-3909-4317-ab87-877c36019f4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:03.612655 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:03.612587    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:03.615860 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:03.615807    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": read tcp 10.132.0.2:43832->10.132.0.67:8000: read: connection reset by peer"
Oct 30 21:02:03.616632 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:03.616600    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": dial tcp 10.132.0.67:8000: connect: connection refused"
Oct 30 21:02:03.632784 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:03.632672    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 21:02:03.634716 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:03.634676    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": dial tcp 10.132.0.63:8000: connect: connection refused"
Oct 30 21:02:03.853399 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:03.850460    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:03.942430 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:03.941121    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:02:03.942430 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:03.941190    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:02:04.065470 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:04.065106    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:04.100391 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:04.093353    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:04.432398 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:04.426128    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": dial tcp 10.132.0.63:8000: connect: connection refused"
Oct 30 21:02:04.432398 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:04.426606    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:04.669164 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:04.669104    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:04.700455 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:04.675215    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": dial tcp 10.132.0.67:8000: connect: connection refused"
Oct 30 21:02:04.878252 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:04.878197    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:04.967457 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:04.949863    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:02:04.967457 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:04.949936    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:02:05.049527 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:05.047819    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:05.049527 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:05.047898    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw" podUID="ec5914af-5cdd-425a-a0d3-9b6ba2947947" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:05.073549 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:05.073488    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:05.114550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:05.114483    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:05.486387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:05.430591    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": dial tcp 10.132.0.63:8000: connect: connection refused"
Oct 30 21:02:05.486387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:05.431098    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:05.659392 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:05.596617    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": dial tcp 10.132.0.67:8000: connect: connection refused"
Oct 30 21:02:05.721456 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:05.671179    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:05.752942 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:05.752826    4948 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:05.753515 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:05.753487    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"]
Oct 30 21:02:05.844420 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:05.840834    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"]
Oct 30 21:02:06.033455 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:06.032582    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:02:06.033455 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:06.032658    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:02:06.121594 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:06.091809    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:06.121594 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:06.102480    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:06.189409 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:06.148336    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Oct 30 21:02:06.440554 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:06.440493    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:06.500387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:06.463046    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:06.500387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:06.463130    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr" podUID="7123b746-4253-4381-8585-b0090b9fbb22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:06.500387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:06.481300    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": dial tcp 10.132.0.63:8000: connect: connection refused"
Oct 30 21:02:06.649391 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:06.648533    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": dial tcp 10.132.0.67:8000: connect: connection refused"
Oct 30 21:02:06.699460 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:06.674458    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:07.040458 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:07.021504    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:02:07.044084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:07.044021    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:02:07.076395 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:07.072787    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:07.097406 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:07.097029    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:07.142420 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:07.128330    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:07.180388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:07.153560    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Oct 30 21:02:07.377947 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:07.377912    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:07.412876 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:07.412808    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": dial tcp 10.132.0.63:8000: connect: connection refused"
Oct 30 21:02:07.441526 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:07.441471    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:02:07.583276 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:07.583228    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": dial tcp 10.132.0.67:8000: connect: connection refused"
Oct 30 21:02:07.732611 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:07.732489    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 30 21:02:07.939130 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:07.939074    4948 generic.go:356] "Generic (PLEG): container finished" podID="46092a70-fe9a-42be-877a-614c1ddaee73" containerID="24bc7217a6025469c4ec903b45bb44741a51e812b41b36cdadb6596b87ad2fad" exitCode=0
Oct 30 21:02:07.939595 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:07.939567    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" event={"ID":"46092a70-fe9a-42be-877a-614c1ddaee73","Type":"ContainerDied","Data":"24bc7217a6025469c4ec903b45bb44741a51e812b41b36cdadb6596b87ad2fad"}
Oct 30 21:02:08.023747 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.023624    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:02:08.111813 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.111768    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded"
Oct 30 21:02:08.119912 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.118676    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 21:02:08.138711 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.122296    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:02:08.138711 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.122392    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:02:08.138711 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.129535    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": EOF"
Oct 30 21:02:08.308031 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.307920    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": dial tcp 10.132.0.74:8000: connect: connection refused"
Oct 30 21:02:08.309451 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.308999    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:02:08.602650 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.600333    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:08.612477 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.612403    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": dial tcp 10.132.0.67:8000: connect: connection refused"
Oct 30 21:02:08.697746 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.693413    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:02:08.702542 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.702511    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 21:02:08.899384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.899180    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-model-cache\") pod \"46092a70-fe9a-42be-877a-614c1ddaee73\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") "
Oct 30 21:02:08.899384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.899254    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-tmp-dir\") pod \"46092a70-fe9a-42be-877a-614c1ddaee73\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") "
Oct 30 21:02:08.899661 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.899561    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/46092a70-fe9a-42be-877a-614c1ddaee73-kube-api-access-z4tpm\" (UniqueName: \"kubernetes.io/projected/46092a70-fe9a-42be-877a-614c1ddaee73-kube-api-access-z4tpm\") pod \"46092a70-fe9a-42be-877a-614c1ddaee73\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") "
Oct 30 21:02:08.899661 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.899595    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/46092a70-fe9a-42be-877a-614c1ddaee73-tls-certs\" (UniqueName: \"kubernetes.io/secret/46092a70-fe9a-42be-877a-614c1ddaee73-tls-certs\") pod \"46092a70-fe9a-42be-877a-614c1ddaee73\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") "
Oct 30 21:02:08.899769 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.899668    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-home\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-home\") pod \"46092a70-fe9a-42be-877a-614c1ddaee73\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") "
Oct 30 21:02:08.899769 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.899740    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-dshm\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-dshm\") pod \"46092a70-fe9a-42be-877a-614c1ddaee73\" (UID: \"46092a70-fe9a-42be-877a-614c1ddaee73\") "
Oct 30 21:02:08.903523 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.903472    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-model-cache" pod "46092a70-fe9a-42be-877a-614c1ddaee73" (UID: "46092a70-fe9a-42be-877a-614c1ddaee73"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:08.904170 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.904073    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-home" pod "46092a70-fe9a-42be-877a-614c1ddaee73" (UID: "46092a70-fe9a-42be-877a-614c1ddaee73"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:08.904170 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.904141    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-tmp-dir" pod "46092a70-fe9a-42be-877a-614c1ddaee73" (UID: "46092a70-fe9a-42be-877a-614c1ddaee73"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:08.907461 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.907427    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46092a70-fe9a-42be-877a-614c1ddaee73-tls-certs" pod "46092a70-fe9a-42be-877a-614c1ddaee73" (UID: "46092a70-fe9a-42be-877a-614c1ddaee73"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:08.913576 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.913516    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46092a70-fe9a-42be-877a-614c1ddaee73-kube-api-access-z4tpm" pod "46092a70-fe9a-42be-877a-614c1ddaee73" (UID: "46092a70-fe9a-42be-877a-614c1ddaee73"). InnerVolumeSpecName "kube-api-access-z4tpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:08.917092 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.917053    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-dshm" pod "46092a70-fe9a-42be-877a-614c1ddaee73" (UID: "46092a70-fe9a-42be-877a-614c1ddaee73"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:08.936382 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.936206    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:02:08.936382 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.936259    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:02:08.989232 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.988596    4948 generic.go:356] "Generic (PLEG): container finished" podID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerID="e71615238f0c13c5a61b8c0f1a5df6681434821f0026beff12831438a0049dc7" exitCode=0
Oct 30 21:02:08.989232 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.988710    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" event={"ID":"130c8e9f-87a1-4e95-a656-a6c7f65bf509","Type":"ContainerDied","Data":"e71615238f0c13c5a61b8c0f1a5df6681434821f0026beff12831438a0049dc7"}
Oct 30 21:02:08.990138 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.990112    4948 generic.go:356] "Generic (PLEG): container finished" podID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerID="8de156dc54e012b6a86c53948b785e20c8945068ef2df75de95bf0604ab56f4d" exitCode=0
Oct 30 21:02:08.990274 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.990258    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" event={"ID":"e85aacf2-8dd5-4bc7-bfdb-8a5966172785","Type":"ContainerDied","Data":"8de156dc54e012b6a86c53948b785e20c8945068ef2df75de95bf0604ab56f4d"}
Oct 30 21:02:08.992038 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.992009    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" event={"ID":"46092a70-fe9a-42be-877a-614c1ddaee73","Type":"ContainerDied","Data":"c4ffb410ccc9c699d3f40796e0c160abff2fb187e536c10676a7b4678b1e66d0"}
Oct 30 21:02:08.992205 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.992067    4948 scope.go:122] "RemoveContainer" containerID="24bc7217a6025469c4ec903b45bb44741a51e812b41b36cdadb6596b87ad2fad"
Oct 30 21:02:08.992276 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:08.992236    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"
Oct 30 21:02:09.002032 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.001998    4948 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-home\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.002032 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.002028    4948 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-dshm\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.002032 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.002039    4948 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-model-cache\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.002259 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.002048    4948 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46092a70-fe9a-42be-877a-614c1ddaee73-tmp-dir\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.002259 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.002060    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4tpm\" (UniqueName: \"kubernetes.io/projected/46092a70-fe9a-42be-877a-614c1ddaee73-kube-api-access-z4tpm\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.002259 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.002068    4948 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46092a70-fe9a-42be-877a-614c1ddaee73-tls-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.039456 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.039417    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:02:09.044110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.044083    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 21:02:09.080313 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.080268    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"]
Oct 30 21:02:09.112816 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.112733    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc"]
Oct 30 21:02:09.209970 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.209934    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/130c8e9f-87a1-4e95-a656-a6c7f65bf509-tls-certs\" (UniqueName: \"kubernetes.io/secret/130c8e9f-87a1-4e95-a656-a6c7f65bf509-tls-certs\") pod \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") "
Oct 30 21:02:09.210160 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.209999    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-home\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-home\") pod \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") "
Oct 30 21:02:09.210160 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.210039    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-model-cache\") pod \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") "
Oct 30 21:02:09.210160 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.210097    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-tls-certs\" (UniqueName: \"kubernetes.io/secret/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-tls-certs\") pod \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") "
Oct 30 21:02:09.210160 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.210123    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-kube-api-access-rdgbp\" (UniqueName: \"kubernetes.io/projected/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-kube-api-access-rdgbp\") pod \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") "
Oct 30 21:02:09.210428 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.210189    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-tmp-dir\") pod \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") "
Oct 30 21:02:09.210428 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.210222    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-tmp-dir\") pod \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") "
Oct 30 21:02:09.210428 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.210244    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-dshm\") pod \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") "
Oct 30 21:02:09.210428 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.210272    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-dshm\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-dshm\") pod \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") "
Oct 30 21:02:09.210428 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.210328    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-home" pod "e85aacf2-8dd5-4bc7-bfdb-8a5966172785" (UID: "e85aacf2-8dd5-4bc7-bfdb-8a5966172785"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:09.210428 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.210347    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-home\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-home\") pod \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") "
Oct 30 21:02:09.210736 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.210539    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-model-cache\") pod \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\" (UID: \"e85aacf2-8dd5-4bc7-bfdb-8a5966172785\") "
Oct 30 21:02:09.210736 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.210560    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-home" pod "130c8e9f-87a1-4e95-a656-a6c7f65bf509" (UID: "130c8e9f-87a1-4e95-a656-a6c7f65bf509"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:09.210736 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.210618    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/130c8e9f-87a1-4e95-a656-a6c7f65bf509-kube-api-access-vxct2\" (UniqueName: \"kubernetes.io/projected/130c8e9f-87a1-4e95-a656-a6c7f65bf509-kube-api-access-vxct2\") pod \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\" (UID: \"130c8e9f-87a1-4e95-a656-a6c7f65bf509\") "
Oct 30 21:02:09.210736 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.210621    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-tmp-dir" pod "130c8e9f-87a1-4e95-a656-a6c7f65bf509" (UID: "130c8e9f-87a1-4e95-a656-a6c7f65bf509"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:09.210935 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.210784    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-tmp-dir" pod "e85aacf2-8dd5-4bc7-bfdb-8a5966172785" (UID: "e85aacf2-8dd5-4bc7-bfdb-8a5966172785"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:09.210935 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.210790    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-model-cache" pod "130c8e9f-87a1-4e95-a656-a6c7f65bf509" (UID: "130c8e9f-87a1-4e95-a656-a6c7f65bf509"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:09.211442 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.211416    4948 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-home\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.211638 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.211621    4948 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-model-cache\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.211802 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.211786    4948 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-tmp-dir\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.211916 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.211903    4948 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-tmp-dir\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.212022 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.212009    4948 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-home\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.212116 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.211474    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-model-cache" pod "e85aacf2-8dd5-4bc7-bfdb-8a5966172785" (UID: "e85aacf2-8dd5-4bc7-bfdb-8a5966172785"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:09.215764 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.215728    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-tls-certs" pod "e85aacf2-8dd5-4bc7-bfdb-8a5966172785" (UID: "e85aacf2-8dd5-4bc7-bfdb-8a5966172785"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:09.226568 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.224860    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-dshm" pod "e85aacf2-8dd5-4bc7-bfdb-8a5966172785" (UID: "e85aacf2-8dd5-4bc7-bfdb-8a5966172785"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:09.228191 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.228136    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/130c8e9f-87a1-4e95-a656-a6c7f65bf509-kube-api-access-vxct2" pod "130c8e9f-87a1-4e95-a656-a6c7f65bf509" (UID: "130c8e9f-87a1-4e95-a656-a6c7f65bf509"). InnerVolumeSpecName "kube-api-access-vxct2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:09.228423 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.228248    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-kube-api-access-rdgbp" pod "e85aacf2-8dd5-4bc7-bfdb-8a5966172785" (UID: "e85aacf2-8dd5-4bc7-bfdb-8a5966172785"). InnerVolumeSpecName "kube-api-access-rdgbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:09.229570 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.229531    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-dshm" pod "130c8e9f-87a1-4e95-a656-a6c7f65bf509" (UID: "130c8e9f-87a1-4e95-a656-a6c7f65bf509"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:09.230660 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.230632    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/130c8e9f-87a1-4e95-a656-a6c7f65bf509-tls-certs" pod "130c8e9f-87a1-4e95-a656-a6c7f65bf509" (UID: "130c8e9f-87a1-4e95-a656-a6c7f65bf509"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:09.313629 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.313581    4948 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-dshm\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.313629 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.313622    4948 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/130c8e9f-87a1-4e95-a656-a6c7f65bf509-dshm\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.313629 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.313635    4948 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-model-cache\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.314154 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.313649    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxct2\" (UniqueName: \"kubernetes.io/projected/130c8e9f-87a1-4e95-a656-a6c7f65bf509-kube-api-access-vxct2\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.314154 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.313662    4948 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/130c8e9f-87a1-4e95-a656-a6c7f65bf509-tls-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.314154 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.313673    4948 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-tls-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.314154 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.313685    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdgbp\" (UniqueName: \"kubernetes.io/projected/e85aacf2-8dd5-4bc7-bfdb-8a5966172785-kube-api-access-rdgbp\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:09.412675 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.412561    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-39fb96/simulator-w6-39fb96-kserve-9c895bbc6-pfqrc" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:09.694463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.691417    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:09.871407 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.870172    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"]
Oct 30 21:02:09.871407 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.871305    4948 cpu_manager.go:414] "containerMap: removing container" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main"
Oct 30 21:02:09.871407 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.871334    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main"
Oct 30 21:02:09.871407 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.871410    4948 cpu_manager.go:414] "containerMap: removing container" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main"
Oct 30 21:02:09.871407 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.871420    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main"
Oct 30 21:02:09.871830 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.871445    4948 cpu_manager.go:414] "containerMap: removing container" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main"
Oct 30 21:02:09.871830 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.871454    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main"
Oct 30 21:02:09.871830 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.871745    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" containerName="main"
Oct 30 21:02:09.871830 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.871764    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" containerName="main"
Oct 30 21:02:09.871830 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.871776    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" containerName="main"
Oct 30 21:02:09.896384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.895747    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"
Oct 30 21:02:09.902420 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.897988    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:09.902420 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.901644    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:02:09.909422 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.908640    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:02:09.925449 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.925391    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x\" (UID: \"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"
Oct 30 21:02:09.925605 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.925532    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmkgn\" (UniqueName: \"kubernetes.io/projected/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-kube-api-access-wmkgn\") pod \"maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x\" (UID: \"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"
Oct 30 21:02:09.925675 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.925662    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x\" (UID: \"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"
Oct 30 21:02:09.927295 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.927231    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"]
Oct 30 21:02:09.935569 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.935520    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:02:09.935785 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:09.935583    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:02:10.002157 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.002048    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w" event={"ID":"130c8e9f-87a1-4e95-a656-a6c7f65bf509","Type":"ContainerDied","Data":"5168c78ae87606b25d255030b88d536e94b33e9a6bfcd5e5731352792d0d5c26"}
Oct 30 21:02:10.002157 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.002079    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"
Oct 30 21:02:10.002157 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.002111    4948 scope.go:122] "RemoveContainer" containerID="e71615238f0c13c5a61b8c0f1a5df6681434821f0026beff12831438a0049dc7"
Oct 30 21:02:10.003895 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.003864    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv" event={"ID":"e85aacf2-8dd5-4bc7-bfdb-8a5966172785","Type":"ContainerDied","Data":"3940ba9e134eff56add1c2edc56bf38b153710ebaf9ec30567b71135b4b356cb"}
Oct 30 21:02:10.003994 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.003980    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"
Oct 30 21:02:10.013146 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.013124    4948 scope.go:122] "RemoveContainer" containerID="8de156dc54e012b6a86c53948b785e20c8945068ef2df75de95bf0604ab56f4d"
Oct 30 21:02:10.027142 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.027109    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmkgn\" (UniqueName: \"kubernetes.io/projected/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-kube-api-access-wmkgn\") pod \"maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x\" (UID: \"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"
Oct 30 21:02:10.027330 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.027219    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x\" (UID: \"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"
Oct 30 21:02:10.027420 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.027346    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x\" (UID: \"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"
Oct 30 21:02:10.028025 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.027996    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x\" (UID: \"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"
Oct 30 21:02:10.029977 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.029953    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x\" (UID: \"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"
Oct 30 21:02:10.035419 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.035376    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"]
Oct 30 21:02:10.041378 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.041335    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmkgn\" (UniqueName: \"kubernetes.io/projected/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-kube-api-access-wmkgn\") pod \"maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x\" (UID: \"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"
Oct 30 21:02:10.042041 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.042018    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/distinct-2-w6-39fb96-kserve-697cc8f5dc-8fl5w"]
Oct 30 21:02:10.088753 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.088648    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"]
Oct 30 21:02:10.093889 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.093848    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-39fb96/distinct-w6-39fb96-kserve-884ff796-sfcwv"]
Oct 30 21:02:10.244261 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.244220    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"
Oct 30 21:02:10.303065 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.303023    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="130c8e9f-87a1-4e95-a656-a6c7f65bf509" path="/var/lib/kubelet/pods/130c8e9f-87a1-4e95-a656-a6c7f65bf509/volumes"
Oct 30 21:02:10.303620 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.303601    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="46092a70-fe9a-42be-877a-614c1ddaee73" path="/var/lib/kubelet/pods/46092a70-fe9a-42be-877a-614c1ddaee73/volumes"
Oct 30 21:02:10.304049 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.304033    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e85aacf2-8dd5-4bc7-bfdb-8a5966172785" path="/var/lib/kubelet/pods/e85aacf2-8dd5-4bc7-bfdb-8a5966172785/volumes"
Oct 30 21:02:10.555405 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.555354    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"]
Oct 30 21:02:10.560114 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:02:10.560074    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29eb7bfd_a761_4a8c_9de1_9e44a58f24d2.slice/crio-65cff3edee2b7665f7af67018775d922e7e2bcb5b7174a08f288251d5c9d5022 WatchSource:0}: Error finding container 65cff3edee2b7665f7af67018775d922e7e2bcb5b7174a08f288251d5c9d5022: Status 404 returned error can't find the container with id 65cff3edee2b7665f7af67018775d922e7e2bcb5b7174a08f288251d5c9d5022
Oct 30 21:02:10.754119 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.754060    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs" podUID="8f33af97-c07d-41b5-a777-dc5b93aabfcf" containerName="payload-processing" containerID="cri-o://8758f978e653651f1bdb6987637ea8aabcd30ab7501b85ff964af2d14e25d693" gracePeriod=25
Oct 30 21:02:10.841431 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.841382    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp" podUID="c8f9dbca-3c12-4f9e-81cc-35240b0a3210" containerName="payload-pre-processing" containerID="cri-o://8551c7646566e10e3ebce440b7fc4998d7bfbd2753e2045ebe25dd8dbbb3ab19" gracePeriod=25
Oct 30 21:02:10.935819 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.935769    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:02:10.936856 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.936823    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:02:10.936998 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:10.936881    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:02:11.014837 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:11.014791    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x" event={"ID":"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2","Type":"ContainerStarted","Data":"4b4115d944619f344a20838edebb33ce89e0556f59ea25b2f677dd0e5ad59dde"}
Oct 30 21:02:11.015029 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:11.014874    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x" event={"ID":"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2","Type":"ContainerStarted","Data":"65cff3edee2b7665f7af67018775d922e7e2bcb5b7174a08f288251d5c9d5022"}
Oct 30 21:02:11.034778 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:11.034702    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x" podStartSLOduration=2.034681484 podStartE2EDuration="2.034681484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:11.033355934 +0000 UTC m=+1398.852867922" watchObservedRunningTime="2026-10-30 21:02:11.034681484 +0000 UTC m=+1398.854193473"
Oct 30 21:02:11.532385 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:11.529209    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:12.025709 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:12.025655    4948 generic.go:356] "Generic (PLEG): container finished" podID="29eb7bfd-a761-4a8c-9de1-9e44a58f24d2" containerID="4b4115d944619f344a20838edebb33ce89e0556f59ea25b2f677dd0e5ad59dde" exitCode=0
Oct 30 21:02:12.026145 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:12.025753    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x" event={"ID":"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2","Type":"ContainerDied","Data":"4b4115d944619f344a20838edebb33ce89e0556f59ea25b2f677dd0e5ad59dde"}
Oct 30 21:02:12.827389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:12.827065    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:12.988426 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:12.988075    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:12.988426 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:12.988171    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:13.252979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:13.252927    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"
Oct 30 21:02:13.302003 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:13.301563    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-maas-api-xks-ca\") pod \"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2\" (UID: \"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2\") "
Oct 30 21:02:13.302003 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:13.301626    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-maas-api-openshift-ca\") pod \"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2\" (UID: \"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2\") "
Oct 30 21:02:13.302003 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:13.301871    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-kube-api-access-wmkgn\" (UniqueName: \"kubernetes.io/projected/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-kube-api-access-wmkgn\") pod \"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2\" (UID: \"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2\") "
Oct 30 21:02:13.305556 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:13.305513    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-maas-api-xks-ca" pod "29eb7bfd-a761-4a8c-9de1-9e44a58f24d2" (UID: "29eb7bfd-a761-4a8c-9de1-9e44a58f24d2"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:13.305847 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:13.305802    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-kube-api-access-wmkgn" pod "29eb7bfd-a761-4a8c-9de1-9e44a58f24d2" (UID: "29eb7bfd-a761-4a8c-9de1-9e44a58f24d2"). InnerVolumeSpecName "kube-api-access-wmkgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:13.305923 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:13.305861    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-maas-api-openshift-ca" pod "29eb7bfd-a761-4a8c-9de1-9e44a58f24d2" (UID: "29eb7bfd-a761-4a8c-9de1-9e44a58f24d2"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:13.306279 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:13.306256    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:02:13.309065 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:13.309002    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:02:13.404969 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:13.404847    4948 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-maas-api-xks-ca\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:13.406679 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:13.406646    4948 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-maas-api-openshift-ca\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:13.406897 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:13.406882    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmkgn\" (UniqueName: \"kubernetes.io/projected/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2-kube-api-access-wmkgn\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:13.694242 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:13.692718    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:14.042448 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:14.042350    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"
Oct 30 21:02:14.042448 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:14.042384    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x" event={"ID":"29eb7bfd-a761-4a8c-9de1-9e44a58f24d2","Type":"ContainerDied","Data":"65cff3edee2b7665f7af67018775d922e7e2bcb5b7174a08f288251d5c9d5022"}
Oct 30 21:02:14.042448 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:14.042433    4948 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65cff3edee2b7665f7af67018775d922e7e2bcb5b7174a08f288251d5c9d5022"
Oct 30 21:02:14.246859 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:14.246815    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs" podUID="8f33af97-c07d-41b5-a777-dc5b93aabfcf" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:14.247024 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:14.246987    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp" podUID="c8f9dbca-3c12-4f9e-81cc-35240b0a3210" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:14.500232 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:14.500190    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:14.604279 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:14.604241    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"]
Oct 30 21:02:14.801116 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:14.801012    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:15.376846 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:15.376766    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:16.391749 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:16.391710    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:17.107387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:17.102559    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:18.011263 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:18.011224    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:18.910709 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:18.910671    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:19.244251 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:19.244133    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:19.857591 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:19.857548    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:20.130671 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:20.130568    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"]
Oct 30 21:02:20.145152 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:20.145113    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"]
Oct 30 21:02:20.312298 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:20.312225    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:20.512479 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:20.512315    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:21.386831 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:21.386792    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:22.021097 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:22.021055    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:22.254383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:22.251055    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:22.499441 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:22.499345    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:22.699185 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:22.699138    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:23.042695 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:23.042650    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:23.609356 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:23.609312    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:23.811530 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:23.811487    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:23.932743 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:02:23.932649    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:02:24.246175 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:24.246065    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs" podUID="8f33af97-c07d-41b5-a777-dc5b93aabfcf" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:24.246586 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:24.246554    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp" podUID="c8f9dbca-3c12-4f9e-81cc-35240b0a3210" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:24.395462 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:24.395423    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:24.823272 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:24.823231    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"]
Oct 30 21:02:25.055115 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.055072    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:25.135391 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.133173    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx" podUID="a4420d1a-5925-4097-8f45-a84c866412e4" containerName="payload-processing" containerID="cri-o://2eb8e1e7732ebf178a5179340b7805fcecfc0c627e1a79d01291e436d5b47583" gracePeriod=25
Oct 30 21:02:25.151939 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.145587    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55" podUID="c7a5ee70-6beb-43bf-813e-d45272a970e6" containerName="payload-pre-processing" containerID="cri-o://38c3e94ea25a80e9fdec34c116af187cf06e87f26dacaf3ae56f5d4f6cec81f0" gracePeriod=25
Oct 30 21:02:25.256827 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.256761    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:25.512067 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.511970    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"]
Oct 30 21:02:25.512989 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.512960    4948 cpu_manager.go:414] "containerMap: removing container" podUID="29eb7bfd-a761-4a8c-9de1-9e44a58f24d2" containerName="revoke-keys"
Oct 30 21:02:25.512989 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.512989    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29eb7bfd-a761-4a8c-9de1-9e44a58f24d2" containerName="revoke-keys"
Oct 30 21:02:25.513213 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.513132    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="29eb7bfd-a761-4a8c-9de1-9e44a58f24d2" containerName="revoke-keys"
Oct 30 21:02:25.517405 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.517374    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.538586 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.538549    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"]
Oct 30 21:02:25.539998 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.539957    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.540136 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.540087    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.540220 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.540138    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.540220 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.540165    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c5s7\" (UniqueName: \"kubernetes.io/projected/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-kube-api-access-6c5s7\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.540326 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.540249    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.540452 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.540408    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.540658 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.540627    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.540734 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.540706    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.540796 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.540744    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.641785 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.641739    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.642016 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.641823    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.642016 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.641852    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c5s7\" (UniqueName: \"kubernetes.io/projected/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-kube-api-access-6c5s7\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.642016 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.641908    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.642212 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.642034    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.642212 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.642109    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.642212 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.642145    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.642212 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.642181    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.642445 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.642278    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.642445 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.642386    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.642445 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.642426    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.642613 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.642591    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.642738 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.642710    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.643170 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.643147    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.644825 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.644799    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.645046 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.645021    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.655407 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.655354    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.656632 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.656596    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c5s7\" (UniqueName: \"kubernetes.io/projected/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-kube-api-access-6c5s7\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:25.843236 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:25.843195    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:26.176120 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.165841    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:26.219465 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.214482    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"]
Oct 30 21:02:26.235408 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.229697    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:02:26.235408 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.229829    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:02:26.235408 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.229872    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:02:26.235408 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.232512    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"]
Oct 30 21:02:26.241373 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.241311    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.251981 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.251832    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" event={"ID":"ce51fe2f-476c-4e0e-8b93-d4d71290ed18","Type":"ContainerStarted","Data":"86ca2d2f177d223d1b4f8e6eb6a27859b99a5bc65eca4cca38fdb0ed943f7d8e"}
Oct 30 21:02:26.257264 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.257231    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"]
Oct 30 21:02:26.307016 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.304534    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"]
Oct 30 21:02:26.312136 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.312104    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.347336 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.347298    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"]
Oct 30 21:02:26.349372 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.349287    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"]
Oct 30 21:02:26.358656 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.355866    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.359534 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.359504    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"]
Oct 30 21:02:26.362077 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.360784    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.362253 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.362235    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.362466 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.362437    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk7s2\" (UniqueName: \"kubernetes.io/projected/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-kube-api-access-rk7s2\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.362584 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.362511    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.362584 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.362561    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.362688 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.362634    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.362762 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.362728    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.362762 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.362744    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.362855 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.362781    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.466564 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.466163    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.466564 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.466234    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.466564 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.466294    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.466564 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.466391    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk7s2\" (UniqueName: \"kubernetes.io/projected/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-kube-api-access-rk7s2\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.466564 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.466459    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.466564 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.466512    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh7jz\" (UniqueName: \"kubernetes.io/projected/aad11c1f-9bd6-4268-9759-2589245b9a91-kube-api-access-vh7jz\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.466564 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.466544    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.467039 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.466584    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.467039 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.466667    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.467039 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.466695    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.467039 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.466728    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.467039 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.466764    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.467039 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.466788    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.467039 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.466844    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mjg5\" (UniqueName: \"kubernetes.io/projected/459a9978-d5ae-419b-a4c2-ebfa6078326d-kube-api-access-9mjg5\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.467039 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.466902    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.467039 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.466991    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.467039 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.467014    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.467555 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.467048    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.467555 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.467078    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.467555 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.467114    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.467555 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.467147    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aad11c1f-9bd6-4268-9759-2589245b9a91-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.467555 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.467194    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.467555 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.467222    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.467555 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.467276    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.467555 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.467314    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.467555 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.467350    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.467555 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.467457    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/459a9978-d5ae-419b-a4c2-ebfa6078326d-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.484708 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.471806    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.484708 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.473731    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.484708 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.473995    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.484708 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.474323    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.484708 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.475006    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.494055 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.491936    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.494055 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.492193    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.495206 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.495174    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.498783 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.498714    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk7s2\" (UniqueName: \"kubernetes.io/projected/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-kube-api-access-rk7s2\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.569299 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.569238    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.569527 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.569353    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.569527 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.569402    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.569527 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.569446    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aad11c1f-9bd6-4268-9759-2589245b9a91-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.569527 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.569486    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.569754 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.569554    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.569754 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.569600    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.569754 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.569639    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.569754 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.569737    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/459a9978-d5ae-419b-a4c2-ebfa6078326d-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.569960 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.569745    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.569960 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.569861    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.569960 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.569903    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.570125 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.570049    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh7jz\" (UniqueName: \"kubernetes.io/projected/aad11c1f-9bd6-4268-9759-2589245b9a91-kube-api-access-vh7jz\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.570125 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.570093    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.570125 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.570100    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.570273 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.570195    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.570944 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.570434    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.570944 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.570487    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.570944 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.570525    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.570944 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.570568    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.570944 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.570627    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mjg5\" (UniqueName: \"kubernetes.io/projected/459a9978-d5ae-419b-a4c2-ebfa6078326d-kube-api-access-9mjg5\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.570944 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.570714    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.570944 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.570759    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.573836 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.571754    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/459a9978-d5ae-419b-a4c2-ebfa6078326d-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.573836 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.572289    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.573836 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.572322    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aad11c1f-9bd6-4268-9759-2589245b9a91-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.573836 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.572528    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.573836 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.572774    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.574615 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.574565    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.574943 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.574920    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.575608 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.575583    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.575696 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.575644    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.584752 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.584704    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:26.585960 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.585929    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh7jz\" (UniqueName: \"kubernetes.io/projected/aad11c1f-9bd6-4268-9759-2589245b9a91-kube-api-access-vh7jz\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.589620 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.589466    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mjg5\" (UniqueName: \"kubernetes.io/projected/459a9978-d5ae-419b-a4c2-ebfa6078326d-kube-api-access-9mjg5\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.590334 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.590315    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.594266 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.594232    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.702386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.700397    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:26.706461 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.703700    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:26.792276 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:26.791101    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:27.026725 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.022807    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:27.450418 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.450346    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:27.452668 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.452633    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" event={"ID":"ce51fe2f-476c-4e0e-8b93-d4d71290ed18","Type":"ContainerStarted","Data":"2b84cc431a1f659a6ec8c6e351c5c0f74327e0d0278dc728515ab18b78f59903"}
Oct 30 21:02:27.504385 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.499900    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" podStartSLOduration=2.49988186 podStartE2EDuration="2.49988186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:27.496760094 +0000 UTC m=+1415.316272083" watchObservedRunningTime="2026-10-30 21:02:27.49988186 +0000 UTC m=+1415.319393847"
Oct 30 21:02:27.546118 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.546068    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"]
Oct 30 21:02:27.548536 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:02:27.548500    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a1c4f4_5189_457f_89cb_d4b75127d7b9.slice/crio-59fbf8af0e69214507e906b0aaa7da685603645891026b92f6b0c68319c0e3cf WatchSource:0}: Error finding container 59fbf8af0e69214507e906b0aaa7da685603645891026b92f6b0c68319c0e3cf: Status 404 returned error can't find the container with id 59fbf8af0e69214507e906b0aaa7da685603645891026b92f6b0c68319c0e3cf
Oct 30 21:02:27.581434 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.560060    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"]
Oct 30 21:02:27.581434 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.560155    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"]
Oct 30 21:02:27.581434 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.575764    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:02:27.581434 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.575867    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:02:27.581434 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.575916    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:02:27.585657 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.585582    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:02:27.585734 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.585686    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:02:27.585769 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.585732    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:02:27.592972 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:02:27.592926    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad11c1f_9bd6_4268_9759_2589245b9a91.slice/crio-7d82901587393f48618b2f68ab9ea2e7e3ffdc19ccb946b5382b5eaf8ac63a93 WatchSource:0}: Error finding container 7d82901587393f48618b2f68ab9ea2e7e3ffdc19ccb946b5382b5eaf8ac63a93: Status 404 returned error can't find the container with id 7d82901587393f48618b2f68ab9ea2e7e3ffdc19ccb946b5382b5eaf8ac63a93
Oct 30 21:02:27.605319 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.605273    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:02:27.605467 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.605408    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:02:27.605509 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.605474    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:02:27.683107 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.682029    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:27.849412 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.843466    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:27.849412 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.845874    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:27.849412 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:27.845946    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:02:28.245972 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.245924    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:28.525034 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.523458    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"]
Oct 30 21:02:28.539409 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.531179    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:28.667387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.660632    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" event={"ID":"aad11c1f-9bd6-4268-9759-2589245b9a91","Type":"ContainerStarted","Data":"59094c9183b9652a65943cfbc77087db932aa428dd39f79fdfd3e00fba60a34e"}
Oct 30 21:02:28.667387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.660725    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" event={"ID":"aad11c1f-9bd6-4268-9759-2589245b9a91","Type":"ContainerStarted","Data":"7d82901587393f48618b2f68ab9ea2e7e3ffdc19ccb946b5382b5eaf8ac63a93"}
Oct 30 21:02:28.684547 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.683659    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podStartSLOduration=2.6836365129999997 podStartE2EDuration="2.683636513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:28.682104849 +0000 UTC m=+1416.501616838" watchObservedRunningTime="2026-10-30 21:02:28.683636513 +0000 UTC m=+1416.503148501"
Oct 30 21:02:28.706330 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.706298    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:28.720085 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.720050    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:28.720328 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.720302    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:02:28.723988 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.723949    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" event={"ID":"459a9978-d5ae-419b-a4c2-ebfa6078326d","Type":"ContainerStarted","Data":"f8e91bf581e61ef72c68706200a3ba7b3193943bd926d3a936fdb372a30d997b"}
Oct 30 21:02:28.737569 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.737530    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" event={"ID":"459a9978-d5ae-419b-a4c2-ebfa6078326d","Type":"ContainerStarted","Data":"fe61e2c0310ca576d6328f0d10003b1545321a82b4ba8dd8ae0044681a0214ee"}
Oct 30 21:02:28.754390 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.745302    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:28.781703 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.781567    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" event={"ID":"c6a1c4f4-5189-457f-89cb-d4b75127d7b9","Type":"ContainerStarted","Data":"363c6d72bcad40b63a944dbab89c55d9ba8b93e6a2c68fd103d756ac0f5d9923"}
Oct 30 21:02:28.782058 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.782020    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" event={"ID":"c6a1c4f4-5189-457f-89cb-d4b75127d7b9","Type":"ContainerStarted","Data":"59fbf8af0e69214507e906b0aaa7da685603645891026b92f6b0c68319c0e3cf"}
Oct 30 21:02:28.846457 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.842188    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" podStartSLOduration=2.842165691 podStartE2EDuration="2.842165691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:28.755277258 +0000 UTC m=+1416.574789247" watchObservedRunningTime="2026-10-30 21:02:28.842165691 +0000 UTC m=+1416.661677681"
Oct 30 21:02:28.870393 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.847501    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:28.870393 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.847571    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:02:28.935240 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:28.932034    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podStartSLOduration=2.932008767 podStartE2EDuration="2.932008767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:28.806024707 +0000 UTC m=+1416.625536696" watchObservedRunningTime="2026-10-30 21:02:28.932008767 +0000 UTC m=+1416.751520756"
Oct 30 21:02:29.136903 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:29.132590    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:29.593467 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:29.592739    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:29.601404 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:29.596497    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:29.601404 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:29.596567    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:29.667228 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:29.666008    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" containerID="cri-o://02bc100868f6898fff251f47aef0aea25322602950b9d2a0ae0fdcde0839d13c" gracePeriod=45
Oct 30 21:02:29.667228 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:29.666633    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:29.776507 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:29.755476    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:29.813084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:29.812118    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:29.813084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:29.812189    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:02:29.813084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:29.812118    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:29.813084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:29.812672    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:29.849070 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:29.848757    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:29.903969 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:29.887532    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:29.903969 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:29.887597    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:02:29.980016 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:29.971123    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:30.073469 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:30.069893    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:30.080497 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:30.078477    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:30.181777 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:30.181670    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": read tcp 10.132.0.2:44564->10.132.0.70:8000: read: connection reset by peer"
Oct 30 21:02:30.182122 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:30.182101    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:02:30.231546 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:30.231504    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:30.661403 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:30.656510    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:30.730780 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:30.730735    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:30.731082 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:30.731048    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:30.731501 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:30.731477    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:30.736415 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:30.736354    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:02:30.836178 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:30.794507    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:30.836178 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:30.794579    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:30.988382 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:30.984714    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:31.108395 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:31.107838    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": dial tcp 10.132.0.70:8000: connect: connection refused"
Oct 30 21:02:31.376400 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:31.356169    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded"
Oct 30 21:02:31.550416 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:31.397613    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:31.550416 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:31.531217    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:02:31.550416 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:31.440789    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:31.620595 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:02:31.620016    4948 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.327s"
Oct 30 21:02:31.620595 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:31.620165    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:02:31.657980 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:31.657896    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:31.720946 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:31.706568    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:31.720946 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:31.706653    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:31.720946 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:31.707231    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:02:31.763919 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:31.763873    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:31.764156 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:31.763990    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:31.764156 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:31.764101    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:31.764156 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:31.764140    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:02:31.974454 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:31.957993    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:31.993398 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:31.987840    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"]
Oct 30 21:02:32.107643 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:32.107587    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": dial tcp 10.132.0.70:8000: connect: connection refused"
Oct 30 21:02:32.339466 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:32.329804    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:32.339466 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:32.329902    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:02:32.570752 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:32.570705    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"]
Oct 30 21:02:32.620699 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:32.620586    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55" podUID="c7a5ee70-6beb-43bf-813e-d45272a970e6" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:32.655406 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:32.652474    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:32.659634 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:32.659562    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:32.819384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:32.796681    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:32.819384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:32.796762    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:32.819384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:32.798163    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx" podUID="a4420d1a-5925-4097-8f45-a84c866412e4" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:32.917456 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:32.891204    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:32.917456 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:32.891277    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:32.917456 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:32.901454    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:32.917456 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:32.901527    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:02:33.053765 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.019674    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:33.239692 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.239590    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": dial tcp 10.132.0.70:8000: connect: connection refused"
Oct 30 21:02:33.274771 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.274724    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:33.275034 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.275004    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:02:33.431388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.407208    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"]
Oct 30 21:02:33.431975 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.431944    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 21:02:33.435490 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.435449    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"]
Oct 30 21:02:33.461860 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.419887    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:33.469110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.466258    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65" podUID="009d223b-94e0-474f-9588-ef9cab2530ff" containerName="istio-proxy" containerID="cri-o://bc6f197547ae103cf5a215e3f5ecd6b23b588ec05af3a8ff1ff6c6e591bdab1d" gracePeriod=30
Oct 30 21:02:33.486598 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.486538    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph" podUID="31514f00-a0a8-4892-a89d-504474b598be" containerName="istio-proxy" containerID="cri-o://04efece3ca4cf57a45809cb8877dea647a0914c7c36836407d9b657282d71be6" gracePeriod=30
Oct 30 21:02:33.609896 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.586757    4948 generic.go:356] "Generic (PLEG): container finished" podID="8f33af97-c07d-41b5-a777-dc5b93aabfcf" containerID="8758f978e653651f1bdb6987637ea8aabcd30ab7501b85ff964af2d14e25d693" exitCode=0
Oct 30 21:02:33.609896 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.591619    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs" event={"ID":"8f33af97-c07d-41b5-a777-dc5b93aabfcf","Type":"ContainerDied","Data":"8758f978e653651f1bdb6987637ea8aabcd30ab7501b85ff964af2d14e25d693"}
Oct 30 21:02:33.609896 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.598607    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:33.609896 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.598670    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:33.664505 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.655868    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded"
Oct 30 21:02:33.812102 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.702395    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 30 21:02:33.812102 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.706012    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:33.812102 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.725839    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:33.812102 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.706058    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:33.812102 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.725901    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:02:33.896386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.895739    4948 generic.go:356] "Generic (PLEG): container finished" podID="c8f9dbca-3c12-4f9e-81cc-35240b0a3210" containerID="8551c7646566e10e3ebce440b7fc4998d7bfbd2753e2045ebe25dd8dbbb3ab19" exitCode=0
Oct 30 21:02:33.896386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.895916    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp" event={"ID":"c8f9dbca-3c12-4f9e-81cc-35240b0a3210","Type":"ContainerDied","Data":"8551c7646566e10e3ebce440b7fc4998d7bfbd2753e2045ebe25dd8dbbb3ab19"}
Oct 30 21:02:33.920568 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.920523    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:33.920879 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:33.920843    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:02:34.109382 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:34.093946    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:34.365650 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:34.112073    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": dial tcp 10.132.0.70:8000: connect: connection refused"
Oct 30 21:02:34.365650 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:34.285173    4948 generic.go:356] "Generic (PLEG): container finished" podID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerID="02bc100868f6898fff251f47aef0aea25322602950b9d2a0ae0fdcde0839d13c" exitCode=0
Oct 30 21:02:34.365650 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:34.285213    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" event={"ID":"c3cad62a-1e45-4f57-98d0-6388c59c0be6","Type":"ContainerDied","Data":"02bc100868f6898fff251f47aef0aea25322602950b9d2a0ae0fdcde0839d13c"}
Oct 30 21:02:34.365650 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:02:34.285688    4948 logging.go:55] [core] [Channel #765 SubChannel #766]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.56:50052", ServerName: "10.132.0.56:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.56:50052: connect: connection refused"
Oct 30 21:02:34.365650 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:02:34.303691    4948 logging.go:55] [core] [Channel #767 SubChannel #768]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.55:50052", ServerName: "10.132.0.55:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.55:50052: connect: connection refused"
Oct 30 21:02:34.448052 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:34.445509    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:34.587058 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:34.587018    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:34.624442 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:34.607071    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:34.625666 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:34.625631    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 21:02:34.664189 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:34.664139    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded"
Oct 30 21:02:34.737734 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:34.730321    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 30 21:02:34.757423 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:34.754526    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:34.757423 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:34.754595    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:02:34.789752 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:34.789701    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:34.790581 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:34.790426    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:34.852571 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:34.850702    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:34.852571 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:34.850775    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:02:35.009036 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:34.957955    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:35.298078 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:35.298021    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs" podUID="8f33af97-c07d-41b5-a777-dc5b93aabfcf" containerName="payload-processing" probeResult="failure" output="timeout: failed to connect service \"10.132.0.56:50052\" within 1s: context deadline exceeded"
Oct 30 21:02:35.298656 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:35.298632    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"
Oct 30 21:02:35.300020 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:35.298303    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp" podUID="c8f9dbca-3c12-4f9e-81cc-35240b0a3210" containerName="payload-pre-processing" probeResult="failure" output="timeout: failed to connect service \"10.132.0.55:50052\" within 1s: context deadline exceeded"
Oct 30 21:02:35.300489 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:35.300354    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"
Oct 30 21:02:35.600856 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:35.600803    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:35.601166 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:35.601115    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:35.627289 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:35.627238    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:35.667449 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:35.664705    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:35.740404 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:35.733127    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:35.740404 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:35.734696    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:35.740404 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:35.734748    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:02:35.749402 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:35.749254    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:35.749402 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:35.749332    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:36.464660 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:36.464599    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Oct 30 21:02:36.978388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:36.953644    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 21:02:36.990398 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:36.960454    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:36.999406 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:36.994553    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl" podUID="97ca19de-fe6b-41ee-9bc6-146e7df45955" containerName="main" probeResult="failure" output="Get \"https://10.132.0.40:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:36.999406 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:36.996495    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:36.999406 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:36.996577    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:36.999406 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:36.996747    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28" podUID="7f4ad782-1866-4c55-b002-615ea7f0ae80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.41:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:36.999968 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:36.999899    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:02:37.029462 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:36.969607    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 30 21:02:37.057423 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.053908    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:37.057423 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.053999    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:02:37.058712 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.058655    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:37.230665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.178592    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:37.230665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.064947    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k" podUID="4c7b1669-f714-4c25-bef4-1435e11b31fd" containerName="main" probeResult="failure" output="Get \"https://10.132.0.42:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:37.230665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.110022    4948 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:02:37.230665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.178771    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph" podUID="31514f00-a0a8-4892-a89d-504474b598be" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:02:37.230665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.198311    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:37.230665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.198412    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:02:37.510645 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.482064    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws" podUID="1a314402-a3a6-42d4-a9d3-526b464bea78" containerName="payload-processing" containerID="cri-o://d51ab0dbdf5adc17ee899da889681a97e5ecb10ce6325735567acd850a56b9a4" gracePeriod=25
Oct 30 21:02:37.510645 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.483871    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:37.510645 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.484021    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:37.559142 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.558692    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd" podUID="86a4c2e8-bcd1-4b05-89f8-a968f0d4addc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.43:8000/ready\": context deadline exceeded"
Oct 30 21:02:37.696811 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.696760    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:02:37.697261 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.697224    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246" podUID="2a8540f7-c0cd-4778-a5aa-9665ddd8f820" containerName="payload-pre-processing" containerID="cri-o://740a14ce9384f02a9bffe55fe8e081d22b3f28f9077397cbf1a7b202b9c9f67f" gracePeriod=25
Oct 30 21:02:37.763648 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.763529    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:37.763953 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.763918    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:02:37.782880 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.782840    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:37.783187 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.783150    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:37.818461 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.796181    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-home\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-home\") pod \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") "
Oct 30 21:02:37.818765 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.818720    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c3cad62a-1e45-4f57-98d0-6388c59c0be6-kube-api-access-btq7f\" (UniqueName: \"kubernetes.io/projected/c3cad62a-1e45-4f57-98d0-6388c59c0be6-kube-api-access-btq7f\") pod \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") "
Oct 30 21:02:37.818855 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.818836    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c3cad62a-1e45-4f57-98d0-6388c59c0be6-tls-certs\" (UniqueName: \"kubernetes.io/secret/c3cad62a-1e45-4f57-98d0-6388c59c0be6-tls-certs\") pod \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") "
Oct 30 21:02:37.819091 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.819052    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-dshm\") pod \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") "
Oct 30 21:02:37.819351 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.819323    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-model-cache\") pod \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") "
Oct 30 21:02:37.819584 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.819564    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-tmp-dir\") pod \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\" (UID: \"c3cad62a-1e45-4f57-98d0-6388c59c0be6\") "
Oct 30 21:02:37.886389 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:02:37.800601    4948 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.409s"
Oct 30 21:02:38.128829 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.128793    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 21:02:38.129149 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.129136    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:02:38.129324 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:37.917679    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:38.129477 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.129455    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:02:38.139396 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.006958    4948 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:02:38.443575 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.443460    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65" podUID="009d223b-94e0-474f-9588-ef9cab2530ff" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:02:38.445802 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.185653    4948 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" secret="" err="secret \"e2e-worker-w2-32a969-openshift-default-dockercfg-tkmt5\" not found"
Oct 30 21:02:38.452704 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.150852    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:38.915752 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.506202    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:38.943384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.933554    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:38.960319 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.790691    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:38.980542 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.791099    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 30 21:02:39.089630 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.860548    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"
Oct 30 21:02:39.096612 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.718227    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3cad62a-1e45-4f57-98d0-6388c59c0be6-tls-certs" pod "c3cad62a-1e45-4f57-98d0-6388c59c0be6" (UID: "c3cad62a-1e45-4f57-98d0-6388c59c0be6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:39.096861 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.718558    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-model-cache" pod "c3cad62a-1e45-4f57-98d0-6388c59c0be6" (UID: "c3cad62a-1e45-4f57-98d0-6388c59c0be6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:39.096961 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.733875    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:39.097127 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.097094    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:39.097302 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.791071    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 21:02:39.139390 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.087223    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"
Oct 30 21:02:39.139774 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.734483    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-tmp-dir" pod "c3cad62a-1e45-4f57-98d0-6388c59c0be6" (UID: "c3cad62a-1e45-4f57-98d0-6388c59c0be6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:39.139898 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.744431    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-home" pod "c3cad62a-1e45-4f57-98d0-6388c59c0be6" (UID: "c3cad62a-1e45-4f57-98d0-6388c59c0be6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:39.139970 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.789666    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:39.140496 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.849061    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:39.140692 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.140664    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr" podUID="17f8a1bb-f09d-4a66-97eb-242dd0261f2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:39.140795 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.850941    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:39.140916 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.140893    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:02:39.141015 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:38.878756    4948 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:39.141134 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.141116    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" podUID="f77b2b95-869a-4e6b-96e1-ce1382ec7896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:39.146796 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.087320    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-dshm" pod "c3cad62a-1e45-4f57-98d0-6388c59c0be6" (UID: "c3cad62a-1e45-4f57-98d0-6388c59c0be6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:39.161633 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.161539    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:02:39.165162 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.165124    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:39.165525 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.165487    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:39.227413 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.217203    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/echo-simulator-kserve-64b6f8f96c-t7btd" podUID="86a4c2e8-bcd1-4b05-89f8-a968f0d4addc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.43:8000/ready\": context deadline exceeded"
Oct 30 21:02:39.237703 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.235341    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28" podUID="7f4ad782-1866-4c55-b002-615ea7f0ae80" containerName="main" probeResult="failure" output="Get \"https://10.132.0.41:8000/ready\": context deadline exceeded"
Oct 30 21:02:39.366689 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.366652    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:39.371477 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.371441    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"
Oct 30 21:02:39.387684 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.387632    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3cad62a-1e45-4f57-98d0-6388c59c0be6-kube-api-access-btq7f" pod "c3cad62a-1e45-4f57-98d0-6388c59c0be6" (UID: "c3cad62a-1e45-4f57-98d0-6388c59c0be6"). InnerVolumeSpecName "kube-api-access-btq7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:39.452889 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.452332    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"
Oct 30 21:02:39.485446 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.484773    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f33af97-c07d-41b5-a777-dc5b93aabfcf-kube-api-access-lq2jb\" (UniqueName: \"kubernetes.io/projected/8f33af97-c07d-41b5-a777-dc5b93aabfcf-kube-api-access-lq2jb\") pod \"8f33af97-c07d-41b5-a777-dc5b93aabfcf\" (UID: \"8f33af97-c07d-41b5-a777-dc5b93aabfcf\") "
Oct 30 21:02:39.535590 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.484949    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8f9dbca-3c12-4f9e-81cc-35240b0a3210-kube-api-access-jzhhw\" (UniqueName: \"kubernetes.io/projected/c8f9dbca-3c12-4f9e-81cc-35240b0a3210-kube-api-access-jzhhw\") pod \"c8f9dbca-3c12-4f9e-81cc-35240b0a3210\" (UID: \"c8f9dbca-3c12-4f9e-81cc-35240b0a3210\") "
Oct 30 21:02:39.535590 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.534048    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8f33af97-c07d-41b5-a777-dc5b93aabfcf-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f33af97-c07d-41b5-a777-dc5b93aabfcf-plugins-config-volume\") pod \"8f33af97-c07d-41b5-a777-dc5b93aabfcf\" (UID: \"8f33af97-c07d-41b5-a777-dc5b93aabfcf\") "
Oct 30 21:02:39.535590 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.534257    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c8f9dbca-3c12-4f9e-81cc-35240b0a3210-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f9dbca-3c12-4f9e-81cc-35240b0a3210-plugins-config-volume\") pod \"c8f9dbca-3c12-4f9e-81cc-35240b0a3210\" (UID: \"c8f9dbca-3c12-4f9e-81cc-35240b0a3210\") "
Oct 30 21:02:39.537694 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.536720    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f33af97-c07d-41b5-a777-dc5b93aabfcf-plugins-config-volume" pod "8f33af97-c07d-41b5-a777-dc5b93aabfcf" (UID: "8f33af97-c07d-41b5-a777-dc5b93aabfcf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:39.537694 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.537129    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k" podUID="4c7b1669-f714-4c25-bef4-1435e11b31fd" containerName="main" probeResult="failure" output="Get \"https://10.132.0.42:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:39.616559 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:02:39.569373    4948 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.16s"
Oct 30 21:02:39.616559 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.569530    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp" event={"ID":"c8f9dbca-3c12-4f9e-81cc-35240b0a3210","Type":"ContainerDied","Data":"32acf5e885d83ce7172fa16540d42061e0ec7c61bda21efeca99a837bbe9a69a"}
Oct 30 21:02:39.616559 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.569573    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"]
Oct 30 21:02:39.616559 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.569615    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g" event={"ID":"c3cad62a-1e45-4f57-98d0-6388c59c0be6","Type":"ContainerDied","Data":"7c0f245e9e94562875bbc1c74669ae8afcb71518b176a743355699b0f2d47d41"}
Oct 30 21:02:39.616559 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.569634    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs" event={"ID":"8f33af97-c07d-41b5-a777-dc5b93aabfcf","Type":"ContainerDied","Data":"21fc741cde5b177f545e1395fe3b03b1b05f601a9c5f6e43ff9d0f83c57d89b5"}
Oct 30 21:02:39.616559 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.569698    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 21:02:39.616559 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.569751    4948 scope.go:122] "RemoveContainer" containerID="8551c7646566e10e3ebce440b7fc4998d7bfbd2753e2045ebe25dd8dbbb3ab19"
Oct 30 21:02:39.616559 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.573700    4948 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-tmp-dir\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:39.616559 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.582266    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr" podUID="17307650-956b-4f4c-be36-cbfdf82feb0d" containerName="istio-proxy" containerID="cri-o://746d5edb499d6bc5a27cd6d11b3e8c6e296f1b2997a4cadc767ace0a222ac20f" gracePeriod=30
Oct 30 21:02:39.649446 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.643234    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:39.649446 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.643292    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:39.716376 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.715636    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:39.716376 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.715701    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:02:39.716771 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.716747    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:39.716924 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.716902    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:39.751555 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.751511    4948 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-home\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:39.758391 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.756970    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8f9dbca-3c12-4f9e-81cc-35240b0a3210-plugins-config-volume" pod "c8f9dbca-3c12-4f9e-81cc-35240b0a3210" (UID: "c8f9dbca-3c12-4f9e-81cc-35240b0a3210"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:39.815198 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.815165    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btq7f\" (UniqueName: \"kubernetes.io/projected/c3cad62a-1e45-4f57-98d0-6388c59c0be6-kube-api-access-btq7f\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:39.815519 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.815499    4948 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3cad62a-1e45-4f57-98d0-6388c59c0be6-tls-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:39.815641 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.815628    4948 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-dshm\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:39.815745 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.815721    4948 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3cad62a-1e45-4f57-98d0-6388c59c0be6-model-cache\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:39.822137 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.822101    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"]
Oct 30 21:02:39.848893 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.848800    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" containerID="cri-o://1663631f478a23d018345e34e7efe42cae08366a710ff9d2345a7a1763f46d0f" gracePeriod=45
Oct 30 21:02:39.850132 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.849938    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:39.850132 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.850012    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:02:39.980447 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.951208    4948 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f9dbca-3c12-4f9e-81cc-35240b0a3210-plugins-config-volume\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:40.062037 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:39.996870    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f9dbca-3c12-4f9e-81cc-35240b0a3210-kube-api-access-jzhhw" pod "c8f9dbca-3c12-4f9e-81cc-35240b0a3210" (UID: "c8f9dbca-3c12-4f9e-81cc-35240b0a3210"). InnerVolumeSpecName "kube-api-access-jzhhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:40.062274 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.029403    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-9pr9k"
Oct 30 21:02:40.062459 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.029804    4948 scope.go:122] "RemoveContainer" containerID="02bc100868f6898fff251f47aef0aea25322602950b9d2a0ae0fdcde0839d13c"
Oct 30 21:02:40.112337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.069133    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f33af97-c07d-41b5-a777-dc5b93aabfcf-kube-api-access-lq2jb" pod "8f33af97-c07d-41b5-a777-dc5b93aabfcf" (UID: "8f33af97-c07d-41b5-a777-dc5b93aabfcf"). InnerVolumeSpecName "kube-api-access-lq2jb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:40.112337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.091596    4948 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f33af97-c07d-41b5-a777-dc5b93aabfcf-plugins-config-volume\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:40.112337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.092493    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"]
Oct 30 21:02:40.112337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.092758    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj" podUID="8c9c8245-6152-4562-88da-2264625bc3da" containerName="istio-proxy" containerID="cri-o://875431c5182aeb00c0329a86a60565dfec90d547dc8c96c51d0e94d65cf39502" gracePeriod=30
Oct 30 21:02:40.112337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.111547    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": dial tcp 10.132.0.77:8000: connect: connection refused"
Oct 30 21:02:40.198864 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.126680    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 21:02:40.198864 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.128636    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 30 21:02:40.498878 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.483198    4948 scope.go:122] "RemoveContainer" containerID="8758f978e653651f1bdb6987637ea8aabcd30ab7501b85ff964af2d14e25d693"
Oct 30 21:02:40.526383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.515497    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzhhw\" (UniqueName: \"kubernetes.io/projected/c8f9dbca-3c12-4f9e-81cc-35240b0a3210-kube-api-access-jzhhw\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:40.526383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.515563    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq2jb\" (UniqueName: \"kubernetes.io/projected/8f33af97-c07d-41b5-a777-dc5b93aabfcf-kube-api-access-lq2jb\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:40.587386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.587111    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:40.587386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.587184    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:40.724640 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.724537    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:40.768573 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.768516    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:40.769218 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.738229    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:40.935388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.902055    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:02:40.935388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.879005    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:40.935388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:40.902224    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:02:41.145393 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.144646    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:41.145393 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.144911    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 21:02:41.183200 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.183164    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:41.380969 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.277090    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": dial tcp 10.132.0.77:8000: connect: connection refused"
Oct 30 21:02:41.380969 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.277221    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:02:41.595455 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.590914    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:41.605439 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.604009    4948 generic.go:356] "Generic (PLEG): container finished" podID="31514f00-a0a8-4892-a89d-504474b598be" containerID="04efece3ca4cf57a45809cb8877dea647a0914c7c36836407d9b657282d71be6" exitCode=0
Oct 30 21:02:41.605921 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.605885    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph" event={"ID":"31514f00-a0a8-4892-a89d-504474b598be","Type":"ContainerDied","Data":"04efece3ca4cf57a45809cb8877dea647a0914c7c36836407d9b657282d71be6"}
Oct 30 21:02:41.606123 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.606102    4948 scope.go:122] "RemoveContainer" containerID="4e66f4ee8afa86275293eb3f10b9c06fc0e1b5fb919b70de593d93631b15729a"
Oct 30 21:02:41.645532 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.639796    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:41.645532 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.639863    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:41.702220 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.678860    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"
Oct 30 21:02:41.720610 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.705069    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:41.720610 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.706173    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:41.720610 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.707750    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:41.720610 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.707806    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:41.720610 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.708402    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:41.720610 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.708440    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:02:41.852488 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.840913    4948 generic.go:356] "Generic (PLEG): container finished" podID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerID="1663631f478a23d018345e34e7efe42cae08366a710ff9d2345a7a1763f46d0f" exitCode=0
Oct 30 21:02:41.852488 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.841143    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" event={"ID":"4d85be7b-dc46-49ad-b587-6dba0ce67823","Type":"ContainerDied","Data":"1663631f478a23d018345e34e7efe42cae08366a710ff9d2345a7a1763f46d0f"}
Oct 30 21:02:41.852488 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.848248    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:41.852488 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.848311    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:02:41.864938 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.855730    4948 generic.go:356] "Generic (PLEG): container finished" podID="009d223b-94e0-474f-9588-ef9cab2530ff" containerID="bc6f197547ae103cf5a215e3f5ecd6b23b588ec05af3a8ff1ff6c6e591bdab1d" exitCode=0
Oct 30 21:02:41.864938 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.864634    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65" event={"ID":"009d223b-94e0-474f-9588-ef9cab2530ff","Type":"ContainerDied","Data":"bc6f197547ae103cf5a215e3f5ecd6b23b588ec05af3a8ff1ff6c6e591bdab1d"}
Oct 30 21:02:41.864938 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.864923    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" podUID="f77b2b95-869a-4e6b-96e1-ce1382ec7896" containerName="istio-proxy" containerID="cri-o://0468cca518a63997ca3c2309b100c3b1dec0d022f5d5c315a6178bdeaa39b50e" gracePeriod=30
Oct 30 21:02:42.017648 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:41.975461    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"]
Oct 30 21:02:42.069388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.050179    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:02:42.073391 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.070083    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": dial tcp 10.132.0.77:8000: connect: connection refused"
Oct 30 21:02:42.192502 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.190821    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/distinct-w0-4a0c5b-kserve-649b4c69b-m4s7g"]
Oct 30 21:02:42.192502 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.191966    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:42.192502 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.192081    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:42.279389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.275582    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55" podUID="c7a5ee70-6beb-43bf-813e-d45272a970e6" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:42.317555 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.317489    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx" podUID="a4420d1a-5925-4097-8f45-a84c866412e4" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:42.733560 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.727709    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:42.733560 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.727765    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:42.733560 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.729351    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:42.733560 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.729470    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:42.733560 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.729767    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:42.733560 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.729800    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:02:42.765467 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.765393    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" path="/var/lib/kubelet/pods/c3cad62a-1e45-4f57-98d0-6388c59c0be6/volumes"
Oct 30 21:02:42.789279 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.789240    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 21:02:42.795482 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.795447    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"]
Oct 30 21:02:42.819712 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.795923    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-32a969-87944f8db-gqvvs"]
Oct 30 21:02:42.820067 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.820022    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"]
Oct 30 21:02:42.820284 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.820267    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-32a969-859d86d4c5-f9vsp"]
Oct 30 21:02:42.919131 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.919092    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:02:42.975556 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.975510    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65" event={"ID":"009d223b-94e0-474f-9588-ef9cab2530ff","Type":"ContainerDied","Data":"c942697c41502f8d615ecdf794dae9d1fdb2ca3fe0575a917673e02d04ecbedd"}
Oct 30 21:02:42.975916 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.975897    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"
Oct 30 21:02:42.981566 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:42.981512    4948 scope.go:122] "RemoveContainer" containerID="bc6f197547ae103cf5a215e3f5ecd6b23b588ec05af3a8ff1ff6c6e591bdab1d"
Oct 30 21:02:43.032052 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.029349    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-istio-data\") pod \"009d223b-94e0-474f-9588-ef9cab2530ff\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") "
Oct 30 21:02:43.032052 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.029496    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-workload-certs\") pod \"009d223b-94e0-474f-9588-ef9cab2530ff\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") "
Oct 30 21:02:43.032052 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.029587    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/009d223b-94e0-474f-9588-ef9cab2530ff-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/009d223b-94e0-474f-9588-ef9cab2530ff-istiod-ca-cert\") pod \"009d223b-94e0-474f-9588-ef9cab2530ff\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") "
Oct 30 21:02:43.032052 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.029629    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-istio-envoy\") pod \"009d223b-94e0-474f-9588-ef9cab2530ff\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") "
Oct 30 21:02:43.032052 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.029754    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/009d223b-94e0-474f-9588-ef9cab2530ff-kube-api-access-zgt2c\" (UniqueName: \"kubernetes.io/projected/009d223b-94e0-474f-9588-ef9cab2530ff-kube-api-access-zgt2c\") pod \"009d223b-94e0-474f-9588-ef9cab2530ff\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") "
Oct 30 21:02:43.032052 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.029985    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/009d223b-94e0-474f-9588-ef9cab2530ff-istio-token\" (UniqueName: \"kubernetes.io/projected/009d223b-94e0-474f-9588-ef9cab2530ff-istio-token\") pod \"009d223b-94e0-474f-9588-ef9cab2530ff\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") "
Oct 30 21:02:43.032052 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.030076    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-credential-socket\") pod \"009d223b-94e0-474f-9588-ef9cab2530ff\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") "
Oct 30 21:02:43.032052 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.030119    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/009d223b-94e0-474f-9588-ef9cab2530ff-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/009d223b-94e0-474f-9588-ef9cab2530ff-istio-podinfo\") pod \"009d223b-94e0-474f-9588-ef9cab2530ff\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") "
Oct 30 21:02:43.032052 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.030196    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-workload-socket\") pod \"009d223b-94e0-474f-9588-ef9cab2530ff\" (UID: \"009d223b-94e0-474f-9588-ef9cab2530ff\") "
Oct 30 21:02:43.033878 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.033839    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-workload-socket" pod "009d223b-94e0-474f-9588-ef9cab2530ff" (UID: "009d223b-94e0-474f-9588-ef9cab2530ff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.034278 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.034255    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-istio-data" pod "009d223b-94e0-474f-9588-ef9cab2530ff" (UID: "009d223b-94e0-474f-9588-ef9cab2530ff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.034681 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.034658    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-workload-certs" pod "009d223b-94e0-474f-9588-ef9cab2530ff" (UID: "009d223b-94e0-474f-9588-ef9cab2530ff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.035128 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.035104    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/009d223b-94e0-474f-9588-ef9cab2530ff-istiod-ca-cert" pod "009d223b-94e0-474f-9588-ef9cab2530ff" (UID: "009d223b-94e0-474f-9588-ef9cab2530ff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:43.047385 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.046882    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-credential-socket" pod "009d223b-94e0-474f-9588-ef9cab2530ff" (UID: "009d223b-94e0-474f-9588-ef9cab2530ff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.057299 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.057241    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:43.061087 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.058068    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/009d223b-94e0-474f-9588-ef9cab2530ff-istio-podinfo" pod "009d223b-94e0-474f-9588-ef9cab2530ff" (UID: "009d223b-94e0-474f-9588-ef9cab2530ff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:02:43.075617 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.075583    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:02:43.076152 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.076120    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/009d223b-94e0-474f-9588-ef9cab2530ff-kube-api-access-zgt2c" pod "009d223b-94e0-474f-9588-ef9cab2530ff" (UID: "009d223b-94e0-474f-9588-ef9cab2530ff"). InnerVolumeSpecName "kube-api-access-zgt2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:43.145295 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.145259    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.147701 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.146502    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/009d223b-94e0-474f-9588-ef9cab2530ff-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.147701 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.146542    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.147701 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.146561    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.147701 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.146575    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.147701 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.146596    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/009d223b-94e0-474f-9588-ef9cab2530ff-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.147701 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.146612    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgt2c\" (UniqueName: \"kubernetes.io/projected/009d223b-94e0-474f-9588-ef9cab2530ff-kube-api-access-zgt2c\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.211493 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.211461    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:02:43.217724 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.217657    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/009d223b-94e0-474f-9588-ef9cab2530ff-istio-token" pod "009d223b-94e0-474f-9588-ef9cab2530ff" (UID: "009d223b-94e0-474f-9588-ef9cab2530ff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:43.218656 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.218613    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-istio-envoy" pod "009d223b-94e0-474f-9588-ef9cab2530ff" (UID: "009d223b-94e0-474f-9588-ef9cab2530ff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.233915 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.233755    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 21:02:43.258725 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.258615    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/009d223b-94e0-474f-9588-ef9cab2530ff-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.258725 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.258661    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/009d223b-94e0-474f-9588-ef9cab2530ff-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.309464 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.308529    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"]
Oct 30 21:02:43.309464 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.308811    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt" podUID="cc19cb54-92ef-4371-a1d1-2107238ea15d" containerName="maas-api" containerID="cri-o://65d3a72924910c133438f7a6270081d810e19553764aa9085bbbfd5e168b198e" gracePeriod=30
Oct 30 21:02:43.343334 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:02:43.339964    4948 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009d223b_94e0_474f_9588_ef9cab2530ff.slice/crio-c942697c41502f8d615ecdf794dae9d1fdb2ca3fe0575a917673e02d04ecbedd\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009d223b_94e0_474f_9588_ef9cab2530ff.slice\": RecentStats: unable to find data in memory cache]"
Oct 30 21:02:43.360666 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.360014    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/31514f00-a0a8-4892-a89d-504474b598be-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31514f00-a0a8-4892-a89d-504474b598be-istiod-ca-cert\") pod \"31514f00-a0a8-4892-a89d-504474b598be\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") "
Oct 30 21:02:43.360666 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.360133    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-tmp-dir\") pod \"4d85be7b-dc46-49ad-b587-6dba0ce67823\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") "
Oct 30 21:02:43.360666 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.360184    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-istio-data\") pod \"31514f00-a0a8-4892-a89d-504474b598be\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") "
Oct 30 21:02:43.360666 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.360216    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-credential-socket\") pod \"31514f00-a0a8-4892-a89d-504474b598be\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") "
Oct 30 21:02:43.360666 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.360262    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-workload-socket\") pod \"31514f00-a0a8-4892-a89d-504474b598be\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") "
Oct 30 21:02:43.360666 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.360329    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-dshm\") pod \"4d85be7b-dc46-49ad-b587-6dba0ce67823\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") "
Oct 30 21:02:43.360666 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.360377    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d85be7b-dc46-49ad-b587-6dba0ce67823-kube-api-access-rsw54\" (UniqueName: \"kubernetes.io/projected/4d85be7b-dc46-49ad-b587-6dba0ce67823-kube-api-access-rsw54\") pod \"4d85be7b-dc46-49ad-b587-6dba0ce67823\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") "
Oct 30 21:02:43.360666 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.360440    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/31514f00-a0a8-4892-a89d-504474b598be-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31514f00-a0a8-4892-a89d-504474b598be-istio-podinfo\") pod \"31514f00-a0a8-4892-a89d-504474b598be\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") "
Oct 30 21:02:43.360666 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.360515    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-istio-envoy\") pod \"31514f00-a0a8-4892-a89d-504474b598be\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") "
Oct 30 21:02:43.360666 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.360594    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31514f00-a0a8-4892-a89d-504474b598be-istio-token\" (UniqueName: \"kubernetes.io/projected/31514f00-a0a8-4892-a89d-504474b598be-istio-token\") pod \"31514f00-a0a8-4892-a89d-504474b598be\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") "
Oct 30 21:02:43.362383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.361696    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-model-cache\") pod \"4d85be7b-dc46-49ad-b587-6dba0ce67823\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") "
Oct 30 21:02:43.362383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.361764    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-home\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-home\") pod \"4d85be7b-dc46-49ad-b587-6dba0ce67823\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") "
Oct 30 21:02:43.362383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.361886    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d85be7b-dc46-49ad-b587-6dba0ce67823-tls-certs\" (UniqueName: \"kubernetes.io/secret/4d85be7b-dc46-49ad-b587-6dba0ce67823-tls-certs\") pod \"4d85be7b-dc46-49ad-b587-6dba0ce67823\" (UID: \"4d85be7b-dc46-49ad-b587-6dba0ce67823\") "
Oct 30 21:02:43.362383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.361933    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31514f00-a0a8-4892-a89d-504474b598be-kube-api-access-qb8g9\" (UniqueName: \"kubernetes.io/projected/31514f00-a0a8-4892-a89d-504474b598be-kube-api-access-qb8g9\") pod \"31514f00-a0a8-4892-a89d-504474b598be\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") "
Oct 30 21:02:43.362383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.361998    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-workload-certs\") pod \"31514f00-a0a8-4892-a89d-504474b598be\" (UID: \"31514f00-a0a8-4892-a89d-504474b598be\") "
Oct 30 21:02:43.367824 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.367515    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-workload-certs" pod "31514f00-a0a8-4892-a89d-504474b598be" (UID: "31514f00-a0a8-4892-a89d-504474b598be"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.368469 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.368171    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31514f00-a0a8-4892-a89d-504474b598be-istiod-ca-cert" pod "31514f00-a0a8-4892-a89d-504474b598be" (UID: "31514f00-a0a8-4892-a89d-504474b598be"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:43.368744 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.368656    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-tmp-dir" pod "4d85be7b-dc46-49ad-b587-6dba0ce67823" (UID: "4d85be7b-dc46-49ad-b587-6dba0ce67823"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.369265 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.369070    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-istio-data" pod "31514f00-a0a8-4892-a89d-504474b598be" (UID: "31514f00-a0a8-4892-a89d-504474b598be"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.369593 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.369422    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-credential-socket" pod "31514f00-a0a8-4892-a89d-504474b598be" (UID: "31514f00-a0a8-4892-a89d-504474b598be"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.370044 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.369725    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-workload-socket" pod "31514f00-a0a8-4892-a89d-504474b598be" (UID: "31514f00-a0a8-4892-a89d-504474b598be"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.384469 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.383600    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-model-cache" pod "4d85be7b-dc46-49ad-b587-6dba0ce67823" (UID: "4d85be7b-dc46-49ad-b587-6dba0ce67823"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.389185 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.386835    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:43.393281 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.392448    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31514f00-a0a8-4892-a89d-504474b598be-istio-token" pod "31514f00-a0a8-4892-a89d-504474b598be" (UID: "31514f00-a0a8-4892-a89d-504474b598be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:43.393281 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.392598    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-dshm" pod "4d85be7b-dc46-49ad-b587-6dba0ce67823" (UID: "4d85be7b-dc46-49ad-b587-6dba0ce67823"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.397867 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.395505    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d85be7b-dc46-49ad-b587-6dba0ce67823-kube-api-access-rsw54" pod "4d85be7b-dc46-49ad-b587-6dba0ce67823" (UID: "4d85be7b-dc46-49ad-b587-6dba0ce67823"). InnerVolumeSpecName "kube-api-access-rsw54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:43.400004 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.399941    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-home" pod "4d85be7b-dc46-49ad-b587-6dba0ce67823" (UID: "4d85be7b-dc46-49ad-b587-6dba0ce67823"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.400278 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.400216    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"]
Oct 30 21:02:43.400995 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.400946    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-istio-envoy" pod "31514f00-a0a8-4892-a89d-504474b598be" (UID: "31514f00-a0a8-4892-a89d-504474b598be"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.402524 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.402478    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31514f00-a0a8-4892-a89d-504474b598be-istio-podinfo" pod "31514f00-a0a8-4892-a89d-504474b598be" (UID: "31514f00-a0a8-4892-a89d-504474b598be"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:02:43.405113 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.404164    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31514f00-a0a8-4892-a89d-504474b598be-kube-api-access-qb8g9" pod "31514f00-a0a8-4892-a89d-504474b598be" (UID: "31514f00-a0a8-4892-a89d-504474b598be"). InnerVolumeSpecName "kube-api-access-qb8g9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:43.405113 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.404959    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d85be7b-dc46-49ad-b587-6dba0ce67823-tls-certs" pod "4d85be7b-dc46-49ad-b587-6dba0ce67823" (UID: "4d85be7b-dc46-49ad-b587-6dba0ce67823"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:43.408505 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.408472    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-fsp65"]
Oct 30 21:02:43.490740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.474378    4948 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-home\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.490740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.474416    4948 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d85be7b-dc46-49ad-b587-6dba0ce67823-tls-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.490740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.474432    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qb8g9\" (UniqueName: \"kubernetes.io/projected/31514f00-a0a8-4892-a89d-504474b598be-kube-api-access-qb8g9\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.490740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.474450    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.490740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.474466    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31514f00-a0a8-4892-a89d-504474b598be-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.490740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.474479    4948 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-tmp-dir\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.490740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.474493    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.490740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.474507    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.490740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.474521    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.490740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.474534    4948 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-dshm\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.490740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.474547    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsw54\" (UniqueName: \"kubernetes.io/projected/4d85be7b-dc46-49ad-b587-6dba0ce67823-kube-api-access-rsw54\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.490740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.474563    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31514f00-a0a8-4892-a89d-504474b598be-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.490740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.474577    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31514f00-a0a8-4892-a89d-504474b598be-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.490740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.474589    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31514f00-a0a8-4892-a89d-504474b598be-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.490740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.474602    4948 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d85be7b-dc46-49ad-b587-6dba0ce67823-model-cache\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.739729 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.692635    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:02:43.739729 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.692699    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:02:43.804660 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.775584    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 21:02:43.804660 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.775655    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 21:02:43.804660 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.776016    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:43.804660 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.776052    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:02:43.804660 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.778742    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:43.941603 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.941451    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"]
Oct 30 21:02:43.942910 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.942864    4948 cpu_manager.go:414] "containerMap: removing container" podUID="8f33af97-c07d-41b5-a777-dc5b93aabfcf" containerName="payload-processing"
Oct 30 21:02:43.943084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.943071    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f33af97-c07d-41b5-a777-dc5b93aabfcf" containerName="payload-processing"
Oct 30 21:02:43.943214 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.943203    4948 cpu_manager.go:414] "containerMap: removing container" podUID="009d223b-94e0-474f-9588-ef9cab2530ff" containerName="istio-proxy"
Oct 30 21:02:43.943297 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.943287    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="009d223b-94e0-474f-9588-ef9cab2530ff" containerName="istio-proxy"
Oct 30 21:02:43.943388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.943377    4948 cpu_manager.go:414] "containerMap: removing container" podUID="c8f9dbca-3c12-4f9e-81cc-35240b0a3210" containerName="payload-pre-processing"
Oct 30 21:02:43.943674 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.943448    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8f9dbca-3c12-4f9e-81cc-35240b0a3210" containerName="payload-pre-processing"
Oct 30 21:02:43.943845 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.943826    4948 cpu_manager.go:414] "containerMap: removing container" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main"
Oct 30 21:02:43.943960 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.943945    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main"
Oct 30 21:02:43.944094 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.944082    4948 cpu_manager.go:414] "containerMap: removing container" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main"
Oct 30 21:02:43.944183 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.944172    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main"
Oct 30 21:02:43.944304 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.944291    4948 cpu_manager.go:414] "containerMap: removing container" podUID="31514f00-a0a8-4892-a89d-504474b598be" containerName="istio-proxy"
Oct 30 21:02:43.944486 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.944471    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="31514f00-a0a8-4892-a89d-504474b598be" containerName="istio-proxy"
Oct 30 21:02:43.944658 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.944632    4948 cpu_manager.go:414] "containerMap: removing container" podUID="31514f00-a0a8-4892-a89d-504474b598be" containerName="istio-proxy"
Oct 30 21:02:43.944764 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.944750    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="31514f00-a0a8-4892-a89d-504474b598be" containerName="istio-proxy"
Oct 30 21:02:43.945094 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.945044    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="8f33af97-c07d-41b5-a777-dc5b93aabfcf" containerName="payload-processing"
Oct 30 21:02:43.945266 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.945251    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="009d223b-94e0-474f-9588-ef9cab2530ff" containerName="istio-proxy"
Oct 30 21:02:43.945425 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.945412    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8f9dbca-3c12-4f9e-81cc-35240b0a3210" containerName="payload-pre-processing"
Oct 30 21:02:43.945992 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.945976    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="c3cad62a-1e45-4f57-98d0-6388c59c0be6" containerName="main"
Oct 30 21:02:43.946121 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.946096    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main"
Oct 30 21:02:43.946234 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.946220    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="31514f00-a0a8-4892-a89d-504474b598be" containerName="istio-proxy"
Oct 30 21:02:43.946335 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.946324    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="31514f00-a0a8-4892-a89d-504474b598be" containerName="istio-proxy"
Oct 30 21:02:44.060038 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:43.989804    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" containerID="cri-o://7f0f96cac0802cdb19a414f8bb48f69d8968be683e334e9dd01659413bb3c1dc" gracePeriod=45
Oct 30 21:02:44.060038 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.026749    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:44.079513 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.068497    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:44.092714 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.092678    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"
Oct 30 21:02:44.117756 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.100340    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:02:44.117756 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.100625    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:02:44.128268 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.122853    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph" event={"ID":"31514f00-a0a8-4892-a89d-504474b598be","Type":"ContainerDied","Data":"2c3c48c62207900641dfb1341b8bf73da3755627cf869438ffd0ed787e45fcf2"}
Oct 30 21:02:44.128268 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.122940    4948 scope.go:122] "RemoveContainer" containerID="04efece3ca4cf57a45809cb8877dea647a0914c7c36836407d9b657282d71be6"
Oct 30 21:02:44.128268 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.123085    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"
Oct 30 21:02:44.234245 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.182281    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/21834f97-ced2-4e07-9b75-674e07e584a5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ca0e90c3-7slxj\" (UID: \"21834f97-ced2-4e07-9b75-674e07e584a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"
Oct 30 21:02:44.234245 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.182557    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-549ql\" (UniqueName: \"kubernetes.io/projected/21834f97-ced2-4e07-9b75-674e07e584a5-kube-api-access-549ql\") pod \"maas-api-revoke-sub-ca0e90c3-7slxj\" (UID: \"21834f97-ced2-4e07-9b75-674e07e584a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"
Oct 30 21:02:44.234245 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.182627    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/21834f97-ced2-4e07-9b75-674e07e584a5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ca0e90c3-7slxj\" (UID: \"21834f97-ced2-4e07-9b75-674e07e584a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"
Oct 30 21:02:44.234245 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.186322    4948 generic.go:356] "Generic (PLEG): container finished" podID="cc19cb54-92ef-4371-a1d1-2107238ea15d" containerID="65d3a72924910c133438f7a6270081d810e19553764aa9085bbbfd5e168b198e" exitCode=0
Oct 30 21:02:44.234245 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.186551    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt" event={"ID":"cc19cb54-92ef-4371-a1d1-2107238ea15d","Type":"ContainerDied","Data":"65d3a72924910c133438f7a6270081d810e19553764aa9085bbbfd5e168b198e"}
Oct 30 21:02:44.324402 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.312227    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"]
Oct 30 21:02:44.331845 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.331803    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246" podUID="2a8540f7-c0cd-4778-a5aa-9665ddd8f820" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:44.337014 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.336767    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-549ql\" (UniqueName: \"kubernetes.io/projected/21834f97-ced2-4e07-9b75-674e07e584a5-kube-api-access-549ql\") pod \"maas-api-revoke-sub-ca0e90c3-7slxj\" (UID: \"21834f97-ced2-4e07-9b75-674e07e584a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"
Oct 30 21:02:44.337315 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.337287    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/21834f97-ced2-4e07-9b75-674e07e584a5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ca0e90c3-7slxj\" (UID: \"21834f97-ced2-4e07-9b75-674e07e584a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"
Oct 30 21:02:44.337761 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.337732    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/21834f97-ced2-4e07-9b75-674e07e584a5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ca0e90c3-7slxj\" (UID: \"21834f97-ced2-4e07-9b75-674e07e584a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"
Oct 30 21:02:44.340666 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.340628    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws" podUID="1a314402-a3a6-42d4-a9d3-526b464bea78" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:44.341941 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.341913    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/21834f97-ced2-4e07-9b75-674e07e584a5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ca0e90c3-7slxj\" (UID: \"21834f97-ced2-4e07-9b75-674e07e584a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"
Oct 30 21:02:44.344148 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.344089    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/21834f97-ced2-4e07-9b75-674e07e584a5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ca0e90c3-7slxj\" (UID: \"21834f97-ced2-4e07-9b75-674e07e584a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"
Oct 30 21:02:44.416281 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.416237    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-549ql\" (UniqueName: \"kubernetes.io/projected/21834f97-ced2-4e07-9b75-674e07e584a5-kube-api-access-549ql\") pod \"maas-api-revoke-sub-ca0e90c3-7slxj\" (UID: \"21834f97-ced2-4e07-9b75-674e07e584a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"
Oct 30 21:02:44.535401 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.535108    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:44.560630 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.552798    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"
Oct 30 21:02:44.563856 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.563469    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"
Oct 30 21:02:44.626252 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.626202    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": dial tcp 10.132.0.82:8000: connect: connection refused"
Oct 30 21:02:44.707394 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.655964    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 21:02:44.919707 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.908908    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:44.939571 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.939531    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="009d223b-94e0-474f-9588-ef9cab2530ff" path="/var/lib/kubelet/pods/009d223b-94e0-474f-9588-ef9cab2530ff/volumes"
Oct 30 21:02:44.941624 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.941573    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8f33af97-c07d-41b5-a777-dc5b93aabfcf" path="/var/lib/kubelet/pods/8f33af97-c07d-41b5-a777-dc5b93aabfcf/volumes"
Oct 30 21:02:44.942619 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.942588    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8f9dbca-3c12-4f9e-81cc-35240b0a3210" path="/var/lib/kubelet/pods/c8f9dbca-3c12-4f9e-81cc-35240b0a3210/volumes"
Oct 30 21:02:44.943820 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.943791    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q" event={"ID":"4d85be7b-dc46-49ad-b587-6dba0ce67823","Type":"ContainerDied","Data":"7c79edaad15ee603070ceb3ba68dbf169df0cde942ca5f2e570c2ff1678932ee"}
Oct 30 21:02:44.944013 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.943993    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"]
Oct 30 21:02:44.944131 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.944119    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-4a0c5b-nsz2x"]
Oct 30 21:02:44.967650 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.957736    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cc19cb54-92ef-4371-a1d1-2107238ea15d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc19cb54-92ef-4371-a1d1-2107238ea15d-maas-api-tls\") pod \"cc19cb54-92ef-4371-a1d1-2107238ea15d\" (UID: \"cc19cb54-92ef-4371-a1d1-2107238ea15d\") "
Oct 30 21:02:44.983967 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.983933    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc19cb54-92ef-4371-a1d1-2107238ea15d-kube-api-access-jvlhl\" (UniqueName: \"kubernetes.io/projected/cc19cb54-92ef-4371-a1d1-2107238ea15d-kube-api-access-jvlhl\") pod \"cc19cb54-92ef-4371-a1d1-2107238ea15d\" (UID: \"cc19cb54-92ef-4371-a1d1-2107238ea15d\") "
Oct 30 21:02:44.997807 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.997760    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cc19cb54-92ef-4371-a1d1-2107238ea15d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc19cb54-92ef-4371-a1d1-2107238ea15d-openshift-service-ca\") pod \"cc19cb54-92ef-4371-a1d1-2107238ea15d\" (UID: \"cc19cb54-92ef-4371-a1d1-2107238ea15d\") "
Oct 30 21:02:45.008646 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.008606    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cc19cb54-92ef-4371-a1d1-2107238ea15d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc19cb54-92ef-4371-a1d1-2107238ea15d-metrics-certs\") pod \"cc19cb54-92ef-4371-a1d1-2107238ea15d\" (UID: \"cc19cb54-92ef-4371-a1d1-2107238ea15d\") "
Oct 30 21:02:45.049391 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:44.971619    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc19cb54-92ef-4371-a1d1-2107238ea15d-maas-api-tls" pod "cc19cb54-92ef-4371-a1d1-2107238ea15d" (UID: "cc19cb54-92ef-4371-a1d1-2107238ea15d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:45.104578 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.010795    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc19cb54-92ef-4371-a1d1-2107238ea15d-openshift-service-ca" pod "cc19cb54-92ef-4371-a1d1-2107238ea15d" (UID: "cc19cb54-92ef-4371-a1d1-2107238ea15d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:45.104578 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.014778    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc19cb54-92ef-4371-a1d1-2107238ea15d-metrics-certs" pod "cc19cb54-92ef-4371-a1d1-2107238ea15d" (UID: "cc19cb54-92ef-4371-a1d1-2107238ea15d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:45.104578 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.027749    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc19cb54-92ef-4371-a1d1-2107238ea15d-kube-api-access-jvlhl" pod "cc19cb54-92ef-4371-a1d1-2107238ea15d" (UID: "cc19cb54-92ef-4371-a1d1-2107238ea15d"). InnerVolumeSpecName "kube-api-access-jvlhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:45.234433 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.218667    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:45.272928 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.248801    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:02:45.272928 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.254849    4948 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc19cb54-92ef-4371-a1d1-2107238ea15d-maas-api-tls\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:45.272928 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.254889    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvlhl\" (UniqueName: \"kubernetes.io/projected/cc19cb54-92ef-4371-a1d1-2107238ea15d-kube-api-access-jvlhl\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:45.272928 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.254910    4948 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc19cb54-92ef-4371-a1d1-2107238ea15d-openshift-service-ca\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:45.272928 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.254925    4948 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc19cb54-92ef-4371-a1d1-2107238ea15d-metrics-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:45.370670 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.365609    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"]
Oct 30 21:02:45.374635 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.374573    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-78wph"]
Oct 30 21:02:45.511740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.511694    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"]
Oct 30 21:02:45.522207 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.522166    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-65968b/distinct-w5-65968b-kserve-5985d9f696-5dh6q"]
Oct 30 21:02:45.650229 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.650123    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:45.671062 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.650707    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": dial tcp 10.132.0.82:8000: connect: connection refused"
Oct 30 21:02:45.671062 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.651143    4948 scope.go:122] "RemoveContainer" containerID="1663631f478a23d018345e34e7efe42cae08366a710ff9d2345a7a1763f46d0f"
Oct 30 21:02:45.673331 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.672779    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:02:45.739439 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.724712    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:02:45.760887 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.760553    4948 generic.go:356] "Generic (PLEG): container finished" podID="a4420d1a-5925-4097-8f45-a84c866412e4" containerID="2eb8e1e7732ebf178a5179340b7805fcecfc0c627e1a79d01291e436d5b47583" exitCode=0
Oct 30 21:02:45.760887 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.760760    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx" event={"ID":"a4420d1a-5925-4097-8f45-a84c866412e4","Type":"ContainerDied","Data":"2eb8e1e7732ebf178a5179340b7805fcecfc0c627e1a79d01291e436d5b47583"}
Oct 30 21:02:45.765741 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.765434    4948 generic.go:356] "Generic (PLEG): container finished" podID="c7a5ee70-6beb-43bf-813e-d45272a970e6" containerID="38c3e94ea25a80e9fdec34c116af187cf06e87f26dacaf3ae56f5d4f6cec81f0" exitCode=0
Oct 30 21:02:45.765741 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.765616    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55" event={"ID":"c7a5ee70-6beb-43bf-813e-d45272a970e6","Type":"ContainerDied","Data":"38c3e94ea25a80e9fdec34c116af187cf06e87f26dacaf3ae56f5d4f6cec81f0"}
Oct 30 21:02:45.769937 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.768624    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt" event={"ID":"cc19cb54-92ef-4371-a1d1-2107238ea15d","Type":"ContainerDied","Data":"6aef979f925285e3c826e958b4f1417360b5baf540af1988fd973fc1e4cf33c4"}
Oct 30 21:02:45.769937 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.768718    4948 scope.go:122] "RemoveContainer" containerID="65d3a72924910c133438f7a6270081d810e19553764aa9085bbbfd5e168b198e"
Oct 30 21:02:45.769937 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.768901    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"
Oct 30 21:02:45.807577 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.807536    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:45.840681 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.838270    4948 generic.go:356] "Generic (PLEG): container finished" podID="17307650-956b-4f4c-be36-cbfdf82feb0d" containerID="746d5edb499d6bc5a27cd6d11b3e8c6e296f1b2997a4cadc767ace0a222ac20f" exitCode=0
Oct 30 21:02:45.840681 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.838467    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr" event={"ID":"17307650-956b-4f4c-be36-cbfdf82feb0d","Type":"ContainerDied","Data":"746d5edb499d6bc5a27cd6d11b3e8c6e296f1b2997a4cadc767ace0a222ac20f"}
Oct 30 21:02:45.861780 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.861725    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"]
Oct 30 21:02:45.913442 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.911047    4948 generic.go:356] "Generic (PLEG): container finished" podID="315d7349-10f7-4c92-a563-b71f12c4f702" containerID="7f0f96cac0802cdb19a414f8bb48f69d8968be683e334e9dd01659413bb3c1dc" exitCode=0
Oct 30 21:02:45.913442 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.912213    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" event={"ID":"315d7349-10f7-4c92-a563-b71f12c4f702","Type":"ContainerDied","Data":"7f0f96cac0802cdb19a414f8bb48f69d8968be683e334e9dd01659413bb3c1dc"}
Oct 30 21:02:45.978903 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.978834    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:45.979896 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.979202    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:45.994322 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:45.994218    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"]
Oct 30 21:02:46.003932 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.003872    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-4a0c5b-996cdc46d-vw4qt"]
Oct 30 21:02:46.511968 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.511909    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:46.520903 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.520872    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:02:46.528834 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.528789    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="29eb7bfd-a761-4a8c-9de1-9e44a58f24d2" path="/var/lib/kubelet/pods/29eb7bfd-a761-4a8c-9de1-9e44a58f24d2/volumes"
Oct 30 21:02:46.529977 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.529946    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="31514f00-a0a8-4892-a89d-504474b598be" path="/var/lib/kubelet/pods/31514f00-a0a8-4892-a89d-504474b598be/volumes"
Oct 30 21:02:46.530961 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.530934    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4d85be7b-dc46-49ad-b587-6dba0ce67823" path="/var/lib/kubelet/pods/4d85be7b-dc46-49ad-b587-6dba0ce67823/volumes"
Oct 30 21:02:46.536331 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.536292    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cc19cb54-92ef-4371-a1d1-2107238ea15d" path="/var/lib/kubelet/pods/cc19cb54-92ef-4371-a1d1-2107238ea15d/volumes"
Oct 30 21:02:46.597724 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.596243    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/315d7349-10f7-4c92-a563-b71f12c4f702-tls-certs\" (UniqueName: \"kubernetes.io/secret/315d7349-10f7-4c92-a563-b71f12c4f702-tls-certs\") pod \"315d7349-10f7-4c92-a563-b71f12c4f702\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") "
Oct 30 21:02:46.597724 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.596320    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-home\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-home\") pod \"315d7349-10f7-4c92-a563-b71f12c4f702\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") "
Oct 30 21:02:46.597724 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.596497    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-model-cache\") pod \"315d7349-10f7-4c92-a563-b71f12c4f702\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") "
Oct 30 21:02:46.597724 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.596573    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/315d7349-10f7-4c92-a563-b71f12c4f702-kube-api-access-wc2bx\" (UniqueName: \"kubernetes.io/projected/315d7349-10f7-4c92-a563-b71f12c4f702-kube-api-access-wc2bx\") pod \"315d7349-10f7-4c92-a563-b71f12c4f702\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") "
Oct 30 21:02:46.597724 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.596623    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-dshm\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-dshm\") pod \"315d7349-10f7-4c92-a563-b71f12c4f702\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") "
Oct 30 21:02:46.597724 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.596699    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-tmp-dir\") pod \"315d7349-10f7-4c92-a563-b71f12c4f702\" (UID: \"315d7349-10f7-4c92-a563-b71f12c4f702\") "
Oct 30 21:02:46.598692 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.598263    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-tmp-dir" pod "315d7349-10f7-4c92-a563-b71f12c4f702" (UID: "315d7349-10f7-4c92-a563-b71f12c4f702"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:46.600098 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.600068    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-home" pod "315d7349-10f7-4c92-a563-b71f12c4f702" (UID: "315d7349-10f7-4c92-a563-b71f12c4f702"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:46.600567 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.600545    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-model-cache" pod "315d7349-10f7-4c92-a563-b71f12c4f702" (UID: "315d7349-10f7-4c92-a563-b71f12c4f702"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:46.642754 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.642537    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/315d7349-10f7-4c92-a563-b71f12c4f702-tls-certs" pod "315d7349-10f7-4c92-a563-b71f12c4f702" (UID: "315d7349-10f7-4c92-a563-b71f12c4f702"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:46.643150 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.643100    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/315d7349-10f7-4c92-a563-b71f12c4f702-kube-api-access-wc2bx" pod "315d7349-10f7-4c92-a563-b71f12c4f702" (UID: "315d7349-10f7-4c92-a563-b71f12c4f702"). InnerVolumeSpecName "kube-api-access-wc2bx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:46.643750 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.643696    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-dshm" pod "315d7349-10f7-4c92-a563-b71f12c4f702" (UID: "315d7349-10f7-4c92-a563-b71f12c4f702"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:46.710088 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.710040    4948 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-model-cache\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:46.710088 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.710092    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc2bx\" (UniqueName: \"kubernetes.io/projected/315d7349-10f7-4c92-a563-b71f12c4f702-kube-api-access-wc2bx\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:46.710352 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.710109    4948 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-dshm\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:46.710352 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.710123    4948 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-tmp-dir\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:46.710352 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.710135    4948 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/315d7349-10f7-4c92-a563-b71f12c4f702-tls-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:46.710352 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.710147    4948 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/315d7349-10f7-4c92-a563-b71f12c4f702-home\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:46.954787 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.954738    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"
Oct 30 21:02:46.958654 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.958616    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 21:02:46.962217 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.962187    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"
Oct 30 21:02:46.964216 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.964180    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv" event={"ID":"315d7349-10f7-4c92-a563-b71f12c4f702","Type":"ContainerDied","Data":"03354a39d81ae8deeb53723f8615bffc6717e25a43ef317e740edbfdad9dfabd"}
Oct 30 21:02:46.972914 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.972865    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj" event={"ID":"21834f97-ced2-4e07-9b75-674e07e584a5","Type":"ContainerStarted","Data":"07a54e817777009128af82a712429799a13c5ab0220124c302bbec7a1bceadce"}
Oct 30 21:02:46.973248 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.973225    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj" event={"ID":"21834f97-ced2-4e07-9b75-674e07e584a5","Type":"ContainerStarted","Data":"7c290ece3eda44b81c0d9173420c96825eaf40a5de40cd538950a504098ea87a"}
Oct 30 21:02:46.973439 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.973421    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj" event={"ID":"8c9c8245-6152-4562-88da-2264625bc3da","Type":"ContainerDied","Data":"875431c5182aeb00c0329a86a60565dfec90d547dc8c96c51d0e94d65cf39502"}
Oct 30 21:02:46.973576 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.965009    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"
Oct 30 21:02:46.975092 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.973162    4948 scope.go:122] "RemoveContainer" containerID="7f0f96cac0802cdb19a414f8bb48f69d8968be683e334e9dd01659413bb3c1dc"
Oct 30 21:02:46.975092 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.965343    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:02:46.975092 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.972592    4948 generic.go:356] "Generic (PLEG): container finished" podID="8c9c8245-6152-4562-88da-2264625bc3da" containerID="875431c5182aeb00c0329a86a60565dfec90d547dc8c96c51d0e94d65cf39502" exitCode=0
Oct 30 21:02:46.975092 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.974895    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj" event={"ID":"8c9c8245-6152-4562-88da-2264625bc3da","Type":"ContainerDied","Data":"6260dc17651922db1ae25c5c56a491d3816ef588bedd42a739df230a748623b7"}
Oct 30 21:02:46.979531 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.979471    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx" event={"ID":"a4420d1a-5925-4097-8f45-a84c866412e4","Type":"ContainerDied","Data":"038d8b1957fee76649b681d714d299e0d17f8b0ff11b9a278d7aa7abf860dd1c"}
Oct 30 21:02:46.979892 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.979855    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"
Oct 30 21:02:46.989663 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.989621    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55" event={"ID":"c7a5ee70-6beb-43bf-813e-d45272a970e6","Type":"ContainerDied","Data":"18d5ca3463334ddfa2cc216ab1082063ff68b1f490ebba4c75cfce78a67976d8"}
Oct 30 21:02:46.990096 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.990070    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"
Oct 30 21:02:46.999699 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.999344    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr" event={"ID":"17307650-956b-4f4c-be36-cbfdf82feb0d","Type":"ContainerDied","Data":"43b205328d6d3da89915f6ed45755198c7e0fad132b7092659260002d7b3cd61"}
Oct 30 21:02:46.999699 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:46.999510    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"
Oct 30 21:02:47.033161 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.033118    4948 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:47.033462 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.033427    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:47.040028 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.038519    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj" podStartSLOduration=4.038497427 podStartE2EDuration="4.038497427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:47.018978896 +0000 UTC m=+1434.838490885" watchObservedRunningTime="2026-10-30 21:02:47.038497427 +0000 UTC m=+1434.858009415"
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.138461    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-istio-envoy\") pod \"8c9c8245-6152-4562-88da-2264625bc3da\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.138573    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-istio-data\") pod \"8c9c8245-6152-4562-88da-2264625bc3da\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.138619    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-workload-socket\") pod \"8c9c8245-6152-4562-88da-2264625bc3da\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.138654    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-workload-certs\") pod \"17307650-956b-4f4c-be36-cbfdf82feb0d\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.138690    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8c9c8245-6152-4562-88da-2264625bc3da-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c9c8245-6152-4562-88da-2264625bc3da-istio-podinfo\") pod \"8c9c8245-6152-4562-88da-2264625bc3da\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.138729    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-workload-certs\") pod \"8c9c8245-6152-4562-88da-2264625bc3da\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.138765    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c9c8245-6152-4562-88da-2264625bc3da-istio-token\" (UniqueName: \"kubernetes.io/projected/8c9c8245-6152-4562-88da-2264625bc3da-istio-token\") pod \"8c9c8245-6152-4562-88da-2264625bc3da\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.138793    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-podinfo\") pod \"17307650-956b-4f4c-be36-cbfdf82feb0d\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.138855    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/17307650-956b-4f4c-be36-cbfdf82feb0d-kube-api-access-hvjrx\" (UniqueName: \"kubernetes.io/projected/17307650-956b-4f4c-be36-cbfdf82feb0d-kube-api-access-hvjrx\") pod \"17307650-956b-4f4c-be36-cbfdf82feb0d\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.138892    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a4420d1a-5925-4097-8f45-a84c866412e4-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4420d1a-5925-4097-8f45-a84c866412e4-plugins-config-volume\") pod \"a4420d1a-5925-4097-8f45-a84c866412e4\" (UID: \"a4420d1a-5925-4097-8f45-a84c866412e4\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.139007    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-envoy\") pod \"17307650-956b-4f4c-be36-cbfdf82feb0d\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.139031    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-data\") pod \"17307650-956b-4f4c-be36-cbfdf82feb0d\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.139210    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-credential-socket\") pod \"8c9c8245-6152-4562-88da-2264625bc3da\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.139260    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/17307650-956b-4f4c-be36-cbfdf82feb0d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17307650-956b-4f4c-be36-cbfdf82feb0d-istiod-ca-cert\") pod \"17307650-956b-4f4c-be36-cbfdf82feb0d\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.139309    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c7a5ee70-6beb-43bf-813e-d45272a970e6-kube-api-access-jx6ct\" (UniqueName: \"kubernetes.io/projected/c7a5ee70-6beb-43bf-813e-d45272a970e6-kube-api-access-jx6ct\") pod \"c7a5ee70-6beb-43bf-813e-d45272a970e6\" (UID: \"c7a5ee70-6beb-43bf-813e-d45272a970e6\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.139390    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-workload-socket\") pod \"17307650-956b-4f4c-be36-cbfdf82feb0d\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.139431    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c7a5ee70-6beb-43bf-813e-d45272a970e6-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7a5ee70-6beb-43bf-813e-d45272a970e6-plugins-config-volume\") pod \"c7a5ee70-6beb-43bf-813e-d45272a970e6\" (UID: \"c7a5ee70-6beb-43bf-813e-d45272a970e6\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.139471    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-credential-socket\") pod \"17307650-956b-4f4c-be36-cbfdf82feb0d\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.139520    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-token\" (UniqueName: \"kubernetes.io/projected/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-token\") pod \"17307650-956b-4f4c-be36-cbfdf82feb0d\" (UID: \"17307650-956b-4f4c-be36-cbfdf82feb0d\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.139566    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8c9c8245-6152-4562-88da-2264625bc3da-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c9c8245-6152-4562-88da-2264625bc3da-istiod-ca-cert\") pod \"8c9c8245-6152-4562-88da-2264625bc3da\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.139599    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a4420d1a-5925-4097-8f45-a84c866412e4-kube-api-access-g7kql\" (UniqueName: \"kubernetes.io/projected/a4420d1a-5925-4097-8f45-a84c866412e4-kube-api-access-g7kql\") pod \"a4420d1a-5925-4097-8f45-a84c866412e4\" (UID: \"a4420d1a-5925-4097-8f45-a84c866412e4\") "
Oct 30 21:02:47.141649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.139625    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c9c8245-6152-4562-88da-2264625bc3da-kube-api-access-5qtrv\" (UniqueName: \"kubernetes.io/projected/8c9c8245-6152-4562-88da-2264625bc3da-kube-api-access-5qtrv\") pod \"8c9c8245-6152-4562-88da-2264625bc3da\" (UID: \"8c9c8245-6152-4562-88da-2264625bc3da\") "
Oct 30 21:02:47.144147 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.144115    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-credential-socket" pod "8c9c8245-6152-4562-88da-2264625bc3da" (UID: "8c9c8245-6152-4562-88da-2264625bc3da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:47.144398 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.144349    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-data" pod "17307650-956b-4f4c-be36-cbfdf82feb0d" (UID: "17307650-956b-4f4c-be36-cbfdf82feb0d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:47.144788 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.144762    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c9c8245-6152-4562-88da-2264625bc3da-istiod-ca-cert" pod "8c9c8245-6152-4562-88da-2264625bc3da" (UID: "8c9c8245-6152-4562-88da-2264625bc3da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:47.145744 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.145722    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-workload-certs" pod "8c9c8245-6152-4562-88da-2264625bc3da" (UID: "8c9c8245-6152-4562-88da-2264625bc3da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:47.146053 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.146033    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-istio-data" pod "8c9c8245-6152-4562-88da-2264625bc3da" (UID: "8c9c8245-6152-4562-88da-2264625bc3da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:47.146341 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.146321    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-workload-socket" pod "8c9c8245-6152-4562-88da-2264625bc3da" (UID: "8c9c8245-6152-4562-88da-2264625bc3da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:47.146648 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.146627    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-workload-certs" pod "17307650-956b-4f4c-be36-cbfdf82feb0d" (UID: "17307650-956b-4f4c-be36-cbfdf82feb0d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:47.146829 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.146802    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-token" pod "17307650-956b-4f4c-be36-cbfdf82feb0d" (UID: "17307650-956b-4f4c-be36-cbfdf82feb0d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:47.149678 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.147139    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17307650-956b-4f4c-be36-cbfdf82feb0d-istiod-ca-cert" pod "17307650-956b-4f4c-be36-cbfdf82feb0d" (UID: "17307650-956b-4f4c-be36-cbfdf82feb0d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:47.158153 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.158113    4948 scope.go:122] "RemoveContainer" containerID="875431c5182aeb00c0329a86a60565dfec90d547dc8c96c51d0e94d65cf39502"
Oct 30 21:02:47.159431 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.159305    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7a5ee70-6beb-43bf-813e-d45272a970e6-plugins-config-volume" pod "c7a5ee70-6beb-43bf-813e-d45272a970e6" (UID: "c7a5ee70-6beb-43bf-813e-d45272a970e6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:47.160042 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.159829    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-workload-socket" pod "17307650-956b-4f4c-be36-cbfdf82feb0d" (UID: "17307650-956b-4f4c-be36-cbfdf82feb0d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:47.162188 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.160184    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-credential-socket" pod "17307650-956b-4f4c-be36-cbfdf82feb0d" (UID: "17307650-956b-4f4c-be36-cbfdf82feb0d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:47.166412 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.165815    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4420d1a-5925-4097-8f45-a84c866412e4-plugins-config-volume" pod "a4420d1a-5925-4097-8f45-a84c866412e4" (UID: "a4420d1a-5925-4097-8f45-a84c866412e4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:47.166412 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.165963    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7a5ee70-6beb-43bf-813e-d45272a970e6-kube-api-access-jx6ct" pod "c7a5ee70-6beb-43bf-813e-d45272a970e6" (UID: "c7a5ee70-6beb-43bf-813e-d45272a970e6"). InnerVolumeSpecName "kube-api-access-jx6ct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:47.174328 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.174273    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-envoy" pod "17307650-956b-4f4c-be36-cbfdf82feb0d" (UID: "17307650-956b-4f4c-be36-cbfdf82feb0d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:47.174723 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.174699    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c9c8245-6152-4562-88da-2264625bc3da-istio-podinfo" pod "8c9c8245-6152-4562-88da-2264625bc3da" (UID: "8c9c8245-6152-4562-88da-2264625bc3da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:02:47.248420 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.246620    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-istio-envoy" pod "8c9c8245-6152-4562-88da-2264625bc3da" (UID: "8c9c8245-6152-4562-88da-2264625bc3da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:47.248420 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.246751    4948 scope.go:122] "RemoveContainer" containerID="2eb8e1e7732ebf178a5179340b7805fcecfc0c627e1a79d01291e436d5b47583"
Oct 30 21:02:47.248420 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.247027    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-podinfo" pod "17307650-956b-4f4c-be36-cbfdf82feb0d" (UID: "17307650-956b-4f4c-be36-cbfdf82feb0d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:02:47.248420 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.247224    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17307650-956b-4f4c-be36-cbfdf82feb0d-kube-api-access-hvjrx" pod "17307650-956b-4f4c-be36-cbfdf82feb0d" (UID: "17307650-956b-4f4c-be36-cbfdf82feb0d"). InnerVolumeSpecName "kube-api-access-hvjrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:47.248420 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.247337    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c9c8245-6152-4562-88da-2264625bc3da-kube-api-access-5qtrv" pod "8c9c8245-6152-4562-88da-2264625bc3da" (UID: "8c9c8245-6152-4562-88da-2264625bc3da"). InnerVolumeSpecName "kube-api-access-5qtrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:47.248420 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.248191    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c9c8245-6152-4562-88da-2264625bc3da-istio-token" pod "8c9c8245-6152-4562-88da-2264625bc3da" (UID: "8c9c8245-6152-4562-88da-2264625bc3da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:47.276439 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.249464    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4420d1a-5925-4097-8f45-a84c866412e4-kube-api-access-g7kql" pod "a4420d1a-5925-4097-8f45-a84c866412e4" (UID: "a4420d1a-5925-4097-8f45-a84c866412e4"). InnerVolumeSpecName "kube-api-access-g7kql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281003    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281051    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17307650-956b-4f4c-be36-cbfdf82feb0d-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281080    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jx6ct\" (UniqueName: \"kubernetes.io/projected/c7a5ee70-6beb-43bf-813e-d45272a970e6-kube-api-access-jx6ct\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281097    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281113    4948 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7a5ee70-6beb-43bf-813e-d45272a970e6-plugins-config-volume\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281131    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281152    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281169    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c9c8245-6152-4562-88da-2264625bc3da-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281185    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7kql\" (UniqueName: \"kubernetes.io/projected/a4420d1a-5925-4097-8f45-a84c866412e4-kube-api-access-g7kql\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281203    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qtrv\" (UniqueName: \"kubernetes.io/projected/8c9c8245-6152-4562-88da-2264625bc3da-kube-api-access-5qtrv\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281224    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281239    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281254    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281269    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281289    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c9c8245-6152-4562-88da-2264625bc3da-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281305    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c9c8245-6152-4562-88da-2264625bc3da-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281323    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c9c8245-6152-4562-88da-2264625bc3da-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281344    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281376    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvjrx\" (UniqueName: \"kubernetes.io/projected/17307650-956b-4f4c-be36-cbfdf82feb0d-kube-api-access-hvjrx\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281393    4948 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4420d1a-5925-4097-8f45-a84c866412e4-plugins-config-volume\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281408    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.281550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.281428    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17307650-956b-4f4c-be36-cbfdf82feb0d-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.384333 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.366740    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"]
Oct 30 21:02:47.417513 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.390082    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/distinct-2-w4-c2d1eb-kserve-678654b47-7wqhv"]
Oct 30 21:02:47.417513 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.390763    4948 scope.go:122] "RemoveContainer" containerID="38c3e94ea25a80e9fdec34c116af187cf06e87f26dacaf3ae56f5d4f6cec81f0"
Oct 30 21:02:47.449474 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.449437    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"]
Oct 30 21:02:47.460474 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.460424    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-4a0c5b-7d6fc654d-rhvpx"]
Oct 30 21:02:47.501227 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.501193    4948 scope.go:122] "RemoveContainer" containerID="746d5edb499d6bc5a27cd6d11b3e8c6e296f1b2997a4cadc767ace0a222ac20f"
Oct 30 21:02:47.507976 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.507945    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"]
Oct 30 21:02:47.516337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.514633    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-nvndr"]
Oct 30 21:02:47.523031 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.522553    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"]
Oct 30 21:02:47.528223 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.528187    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-4a0c5b-ffd7777b7-44p55"]
Oct 30 21:02:47.744684 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.744595    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:02:47.747290 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.747254    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:47.749927 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.749896    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:02:47.832386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.832336    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-workload-socket\") pod \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") "
Oct 30 21:02:47.832666 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.832646    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-token\" (UniqueName: \"kubernetes.io/projected/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-token\") pod \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") "
Oct 30 21:02:47.832762 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.832680    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-envoy\") pod \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") "
Oct 30 21:02:47.832762 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.832707    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f77b2b95-869a-4e6b-96e1-ce1382ec7896-kube-api-access-k7bhq\" (UniqueName: \"kubernetes.io/projected/f77b2b95-869a-4e6b-96e1-ce1382ec7896-kube-api-access-k7bhq\") pod \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") "
Oct 30 21:02:47.832892 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.832770    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-podinfo\") pod \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") "
Oct 30 21:02:47.832892 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.832812    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-data\") pod \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") "
Oct 30 21:02:47.832892 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.832882    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-workload-certs\") pod \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") "
Oct 30 21:02:47.833035 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.832941    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-credential-socket\") pod \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") "
Oct 30 21:02:47.833035 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.832989    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istiod-ca-cert\") pod \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\" (UID: \"f77b2b95-869a-4e6b-96e1-ce1382ec7896\") "
Oct 30 21:02:47.833908 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.833884    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-workload-socket" pod "f77b2b95-869a-4e6b-96e1-ce1382ec7896" (UID: "f77b2b95-869a-4e6b-96e1-ce1382ec7896"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:47.834867 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.834576    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-credential-socket" pod "f77b2b95-869a-4e6b-96e1-ce1382ec7896" (UID: "f77b2b95-869a-4e6b-96e1-ce1382ec7896"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:47.834867 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.834822    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-workload-certs" pod "f77b2b95-869a-4e6b-96e1-ce1382ec7896" (UID: "f77b2b95-869a-4e6b-96e1-ce1382ec7896"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:47.835409 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.835344    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istiod-ca-cert" pod "f77b2b95-869a-4e6b-96e1-ce1382ec7896" (UID: "f77b2b95-869a-4e6b-96e1-ce1382ec7896"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:47.835799 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.835747    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-data" pod "f77b2b95-869a-4e6b-96e1-ce1382ec7896" (UID: "f77b2b95-869a-4e6b-96e1-ce1382ec7896"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:47.836752 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.836726    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-token" pod "f77b2b95-869a-4e6b-96e1-ce1382ec7896" (UID: "f77b2b95-869a-4e6b-96e1-ce1382ec7896"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:47.839401 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.839371    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-podinfo" pod "f77b2b95-869a-4e6b-96e1-ce1382ec7896" (UID: "f77b2b95-869a-4e6b-96e1-ce1382ec7896"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:02:47.840413 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.840324    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-envoy" pod "f77b2b95-869a-4e6b-96e1-ce1382ec7896" (UID: "f77b2b95-869a-4e6b-96e1-ce1382ec7896"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:47.840737 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.840704    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f77b2b95-869a-4e6b-96e1-ce1382ec7896-kube-api-access-k7bhq" pod "f77b2b95-869a-4e6b-96e1-ce1382ec7896" (UID: "f77b2b95-869a-4e6b-96e1-ce1382ec7896"). InnerVolumeSpecName "kube-api-access-k7bhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:47.934540 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.934505    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.934540 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.934536    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.934540 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.934550    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.934820 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.934559    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.934820 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.934572    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.934820 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.934581    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.934820 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.934590    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.934820 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.934598    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7bhq\" (UniqueName: \"kubernetes.io/projected/f77b2b95-869a-4e6b-96e1-ce1382ec7896-kube-api-access-k7bhq\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.934820 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:47.934610    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f77b2b95-869a-4e6b-96e1-ce1382ec7896-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:48.014054 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.013953    4948 generic.go:356] "Generic (PLEG): container finished" podID="f77b2b95-869a-4e6b-96e1-ce1382ec7896" containerID="0468cca518a63997ca3c2309b100c3b1dec0d022f5d5c315a6178bdeaa39b50e" exitCode=0
Oct 30 21:02:48.014054 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.014003    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"
Oct 30 21:02:48.014054 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.014030    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" event={"ID":"f77b2b95-869a-4e6b-96e1-ce1382ec7896","Type":"ContainerDied","Data":"0468cca518a63997ca3c2309b100c3b1dec0d022f5d5c315a6178bdeaa39b50e"}
Oct 30 21:02:48.014348 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.014096    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx" event={"ID":"f77b2b95-869a-4e6b-96e1-ce1382ec7896","Type":"ContainerDied","Data":"341023548d18a4502bb54cca4683e5a5052834fd93b7e33eca6cc0c689587b8a"}
Oct 30 21:02:48.014348 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.014126    4948 scope.go:122] "RemoveContainer" containerID="0468cca518a63997ca3c2309b100c3b1dec0d022f5d5c315a6178bdeaa39b50e"
Oct 30 21:02:48.016862 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.016831    4948 generic.go:356] "Generic (PLEG): container finished" podID="21834f97-ced2-4e07-9b75-674e07e584a5" containerID="07a54e817777009128af82a712429799a13c5ab0220124c302bbec7a1bceadce" exitCode=0
Oct 30 21:02:48.016862 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.016844    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj" event={"ID":"21834f97-ced2-4e07-9b75-674e07e584a5","Type":"ContainerDied","Data":"07a54e817777009128af82a712429799a13c5ab0220124c302bbec7a1bceadce"}
Oct 30 21:02:48.018246 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.018225    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"
Oct 30 21:02:48.160817 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.160790    4948 scope.go:122] "RemoveContainer" containerID="0468cca518a63997ca3c2309b100c3b1dec0d022f5d5c315a6178bdeaa39b50e"
Oct 30 21:02:48.162611 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:02:48.162570    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0468cca518a63997ca3c2309b100c3b1dec0d022f5d5c315a6178bdeaa39b50e\": container with ID starting with 0468cca518a63997ca3c2309b100c3b1dec0d022f5d5c315a6178bdeaa39b50e not found: ID does not exist" containerID="0468cca518a63997ca3c2309b100c3b1dec0d022f5d5c315a6178bdeaa39b50e"
Oct 30 21:02:48.162771 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.162631    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0468cca518a63997ca3c2309b100c3b1dec0d022f5d5c315a6178bdeaa39b50e"} err="failed to get container status \"0468cca518a63997ca3c2309b100c3b1dec0d022f5d5c315a6178bdeaa39b50e\": rpc error: code = NotFound desc = could not find container \"0468cca518a63997ca3c2309b100c3b1dec0d022f5d5c315a6178bdeaa39b50e\": container with ID starting with 0468cca518a63997ca3c2309b100c3b1dec0d022f5d5c315a6178bdeaa39b50e not found: ID does not exist"
Oct 30 21:02:48.164187 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.164155    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:48.186916 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.186872    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"]
Oct 30 21:02:48.192795 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.192752    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-mswxx"]
Oct 30 21:02:48.204495 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.203446    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"]
Oct 30 21:02:48.207665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.207633    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-kg2sj"]
Oct 30 21:02:48.296244 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.296156    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="17307650-956b-4f4c-be36-cbfdf82feb0d" path="/var/lib/kubelet/pods/17307650-956b-4f4c-be36-cbfdf82feb0d/volumes"
Oct 30 21:02:48.296732 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.296715    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" path="/var/lib/kubelet/pods/315d7349-10f7-4c92-a563-b71f12c4f702/volumes"
Oct 30 21:02:48.297173 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.297159    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8c9c8245-6152-4562-88da-2264625bc3da" path="/var/lib/kubelet/pods/8c9c8245-6152-4562-88da-2264625bc3da/volumes"
Oct 30 21:02:48.297804 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.297784    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a4420d1a-5925-4097-8f45-a84c866412e4" path="/var/lib/kubelet/pods/a4420d1a-5925-4097-8f45-a84c866412e4/volumes"
Oct 30 21:02:48.298198 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.298184    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c7a5ee70-6beb-43bf-813e-d45272a970e6" path="/var/lib/kubelet/pods/c7a5ee70-6beb-43bf-813e-d45272a970e6/volumes"
Oct 30 21:02:48.298668 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:48.298653    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f77b2b95-869a-4e6b-96e1-ce1382ec7896" path="/var/lib/kubelet/pods/f77b2b95-869a-4e6b-96e1-ce1382ec7896/volumes"
Oct 30 21:02:49.087340 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:49.085015    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:49.289714 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:49.289631    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"
Oct 30 21:02:49.395084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:49.395046    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/21834f97-ced2-4e07-9b75-674e07e584a5-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/21834f97-ced2-4e07-9b75-674e07e584a5-maas-api-openshift-ca\") pod \"21834f97-ced2-4e07-9b75-674e07e584a5\" (UID: \"21834f97-ced2-4e07-9b75-674e07e584a5\") "
Oct 30 21:02:49.395281 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:49.395230    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/21834f97-ced2-4e07-9b75-674e07e584a5-kube-api-access-549ql\" (UniqueName: \"kubernetes.io/projected/21834f97-ced2-4e07-9b75-674e07e584a5-kube-api-access-549ql\") pod \"21834f97-ced2-4e07-9b75-674e07e584a5\" (UID: \"21834f97-ced2-4e07-9b75-674e07e584a5\") "
Oct 30 21:02:49.395417 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:49.395279    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/21834f97-ced2-4e07-9b75-674e07e584a5-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/21834f97-ced2-4e07-9b75-674e07e584a5-maas-api-xks-ca\") pod \"21834f97-ced2-4e07-9b75-674e07e584a5\" (UID: \"21834f97-ced2-4e07-9b75-674e07e584a5\") "
Oct 30 21:02:49.395569 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:49.395543    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21834f97-ced2-4e07-9b75-674e07e584a5-maas-api-openshift-ca" pod "21834f97-ced2-4e07-9b75-674e07e584a5" (UID: "21834f97-ced2-4e07-9b75-674e07e584a5"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:49.396096 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:49.396070    4948 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/21834f97-ced2-4e07-9b75-674e07e584a5-maas-api-openshift-ca\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:49.397770 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:49.397740    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21834f97-ced2-4e07-9b75-674e07e584a5-maas-api-xks-ca" pod "21834f97-ced2-4e07-9b75-674e07e584a5" (UID: "21834f97-ced2-4e07-9b75-674e07e584a5"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:49.397880 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:49.397860    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21834f97-ced2-4e07-9b75-674e07e584a5-kube-api-access-549ql" pod "21834f97-ced2-4e07-9b75-674e07e584a5" (UID: "21834f97-ced2-4e07-9b75-674e07e584a5"). InnerVolumeSpecName "kube-api-access-549ql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:49.497224 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:49.497179    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-549ql\" (UniqueName: \"kubernetes.io/projected/21834f97-ced2-4e07-9b75-674e07e584a5-kube-api-access-549ql\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:49.497224 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:49.497220    4948 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/21834f97-ced2-4e07-9b75-674e07e584a5-maas-api-xks-ca\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:49.888855 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:49.888818    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:50.070800 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:50.070771    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"
Oct 30 21:02:50.070966 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:50.070890    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj" event={"ID":"21834f97-ced2-4e07-9b75-674e07e584a5","Type":"ContainerDied","Data":"7c290ece3eda44b81c0d9173420c96825eaf40a5de40cd538950a504098ea87a"}
Oct 30 21:02:50.070966 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:50.070939    4948 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c290ece3eda44b81c0d9173420c96825eaf40a5de40cd538950a504098ea87a"
Oct 30 21:02:50.793846 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:50.793810    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:51.316262 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:51.316206    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:51.518326 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:51.518290    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:51.731921 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:51.728124    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:52.540179 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:52.520117    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:53.908385 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:53.890807    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:53.981887 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:02:53.981840    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:02:54.247468 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:54.247331    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws" podUID="1a314402-a3a6-42d4-a9d3-526b464bea78" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:54.247638 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:54.247331    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246" podUID="2a8540f7-c0cd-4778-a5aa-9665ddd8f820" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:54.608831 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:54.608777    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:54.822209 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:54.822164    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"]
Oct 30 21:02:54.822489 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:54.822461    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw" podUID="77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" containerName="istio-proxy" containerID="cri-o://954a531ef719fccba0dae344c7d9f75af8b08821b4819d3a71ef81b341babdb4" gracePeriod=30
Oct 30 21:02:54.831597 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:54.831561    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:54.834881 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:54.834806    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"]
Oct 30 21:02:54.835558 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:54.835512    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy" containerID="cri-o://9751b31383c92566d508e92f39e2c89e5f70fd3246382f73ff7506b077f44a89" gracePeriod=30
Oct 30 21:02:54.843295 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:54.843259    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"]
Oct 30 21:02:54.843808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:54.843775    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr" podUID="17f8a1bb-f09d-4a66-97eb-242dd0261f2b" containerName="istio-proxy" containerID="cri-o://a26d38f6d1ef34a427533c125f61a7ec2814b3ee228a15bec390cafe0035a1b4" gracePeriod=30
Oct 30 21:02:54.864136 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:54.864019    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"]
Oct 30 21:02:54.864334 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:54.864266    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerName="istio-proxy" containerID="cri-o://389450bc2ceba606c110f277a90c9c95c898f30a85adfa028730011357421604" gracePeriod=30
Oct 30 21:02:55.077384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:55.076536    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:55.703051 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:55.702996    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:55.850869 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:55.850826    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:02:55.851081 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:55.850904    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:02:55.927394 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:55.916128    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:56.125065 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:56.125013    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:56.364010 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:56.363952    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:56.588922 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:56.588879    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:56.797237 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:56.797191    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:57.037568 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:57.037468    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:57.435785 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:57.435744    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:57.701153 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:57.701066    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:02:57.701153 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:57.701139    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw" podUID="77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:02:58.201282 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.201158    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:58.210974 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.209585    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"
Oct 30 21:02:58.271823 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.270492    4948 generic.go:356] "Generic (PLEG): container finished" podID="2a8540f7-c0cd-4778-a5aa-9665ddd8f820" containerID="740a14ce9384f02a9bffe55fe8e081d22b3f28f9077397cbf1a7b202b9c9f67f" exitCode=0
Oct 30 21:02:58.271823 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.270600    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246" event={"ID":"2a8540f7-c0cd-4778-a5aa-9665ddd8f820","Type":"ContainerDied","Data":"740a14ce9384f02a9bffe55fe8e081d22b3f28f9077397cbf1a7b202b9c9f67f"}
Oct 30 21:02:58.272772 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.272738    4948 generic.go:356] "Generic (PLEG): container finished" podID="1a314402-a3a6-42d4-a9d3-526b464bea78" containerID="d51ab0dbdf5adc17ee899da889681a97e5ecb10ce6325735567acd850a56b9a4" exitCode=0
Oct 30 21:02:58.272917 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.272858    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws" event={"ID":"1a314402-a3a6-42d4-a9d3-526b464bea78","Type":"ContainerDied","Data":"d51ab0dbdf5adc17ee899da889681a97e5ecb10ce6325735567acd850a56b9a4"}
Oct 30 21:02:58.272982 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.272931    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws" event={"ID":"1a314402-a3a6-42d4-a9d3-526b464bea78","Type":"ContainerDied","Data":"98ab9658ed583f2b05744b6fa71515a0ebb8802f20ba549011e37733136a7c31"}
Oct 30 21:02:58.272982 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.272953    4948 scope.go:122] "RemoveContainer" containerID="d51ab0dbdf5adc17ee899da889681a97e5ecb10ce6325735567acd850a56b9a4"
Oct 30 21:02:58.273141 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.273129    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"
Oct 30 21:02:58.276852 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.276822    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1a314402-a3a6-42d4-a9d3-526b464bea78-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a314402-a3a6-42d4-a9d3-526b464bea78-plugins-config-volume\") pod \"1a314402-a3a6-42d4-a9d3-526b464bea78\" (UID: \"1a314402-a3a6-42d4-a9d3-526b464bea78\") "
Oct 30 21:02:58.277277 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.277250    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a314402-a3a6-42d4-a9d3-526b464bea78-plugins-config-volume" pod "1a314402-a3a6-42d4-a9d3-526b464bea78" (UID: "1a314402-a3a6-42d4-a9d3-526b464bea78"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:58.277819 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.277793    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a314402-a3a6-42d4-a9d3-526b464bea78-kube-api-access-dzdp4\" (UniqueName: \"kubernetes.io/projected/1a314402-a3a6-42d4-a9d3-526b464bea78-kube-api-access-dzdp4\") pod \"1a314402-a3a6-42d4-a9d3-526b464bea78\" (UID: \"1a314402-a3a6-42d4-a9d3-526b464bea78\") "
Oct 30 21:02:58.278521 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.278499    4948 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a314402-a3a6-42d4-a9d3-526b464bea78-plugins-config-volume\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:58.283597 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.283554    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a314402-a3a6-42d4-a9d3-526b464bea78-kube-api-access-dzdp4" pod "1a314402-a3a6-42d4-a9d3-526b464bea78" (UID: "1a314402-a3a6-42d4-a9d3-526b464bea78"). InnerVolumeSpecName "kube-api-access-dzdp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:58.303595 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.303566    4948 scope.go:122] "RemoveContainer" containerID="d51ab0dbdf5adc17ee899da889681a97e5ecb10ce6325735567acd850a56b9a4"
Oct 30 21:02:58.304570 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:02:58.304538    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d51ab0dbdf5adc17ee899da889681a97e5ecb10ce6325735567acd850a56b9a4\": container with ID starting with d51ab0dbdf5adc17ee899da889681a97e5ecb10ce6325735567acd850a56b9a4 not found: ID does not exist" containerID="d51ab0dbdf5adc17ee899da889681a97e5ecb10ce6325735567acd850a56b9a4"
Oct 30 21:02:58.304675 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.304583    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d51ab0dbdf5adc17ee899da889681a97e5ecb10ce6325735567acd850a56b9a4"} err="failed to get container status \"d51ab0dbdf5adc17ee899da889681a97e5ecb10ce6325735567acd850a56b9a4\": rpc error: code = NotFound desc = could not find container \"d51ab0dbdf5adc17ee899da889681a97e5ecb10ce6325735567acd850a56b9a4\": container with ID starting with d51ab0dbdf5adc17ee899da889681a97e5ecb10ce6325735567acd850a56b9a4 not found: ID does not exist"
Oct 30 21:02:58.310524 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.310486    4948 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:02:58.310669 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.310553    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:02:58.315670 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.315635    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"
Oct 30 21:02:58.388393 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.387087    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2a8540f7-c0cd-4778-a5aa-9665ddd8f820-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a8540f7-c0cd-4778-a5aa-9665ddd8f820-plugins-config-volume\") pod \"2a8540f7-c0cd-4778-a5aa-9665ddd8f820\" (UID: \"2a8540f7-c0cd-4778-a5aa-9665ddd8f820\") "
Oct 30 21:02:58.388393 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.387209    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2a8540f7-c0cd-4778-a5aa-9665ddd8f820-kube-api-access-gv9fx\" (UniqueName: \"kubernetes.io/projected/2a8540f7-c0cd-4778-a5aa-9665ddd8f820-kube-api-access-gv9fx\") pod \"2a8540f7-c0cd-4778-a5aa-9665ddd8f820\" (UID: \"2a8540f7-c0cd-4778-a5aa-9665ddd8f820\") "
Oct 30 21:02:58.388393 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.388177    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzdp4\" (UniqueName: \"kubernetes.io/projected/1a314402-a3a6-42d4-a9d3-526b464bea78-kube-api-access-dzdp4\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:58.391605 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.391566    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a8540f7-c0cd-4778-a5aa-9665ddd8f820-plugins-config-volume" pod "2a8540f7-c0cd-4778-a5aa-9665ddd8f820" (UID: "2a8540f7-c0cd-4778-a5aa-9665ddd8f820"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:58.396098 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.396063    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a8540f7-c0cd-4778-a5aa-9665ddd8f820-kube-api-access-gv9fx" pod "2a8540f7-c0cd-4778-a5aa-9665ddd8f820" (UID: "2a8540f7-c0cd-4778-a5aa-9665ddd8f820"). InnerVolumeSpecName "kube-api-access-gv9fx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:58.489522 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.489417    4948 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a8540f7-c0cd-4778-a5aa-9665ddd8f820-plugins-config-volume\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:58.489522 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.489458    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv9fx\" (UniqueName: \"kubernetes.io/projected/2a8540f7-c0cd-4778-a5aa-9665ddd8f820-kube-api-access-gv9fx\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:58.592525 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.592420    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"]
Oct 30 21:02:58.596222 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.596183    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-65968b-b68fc544d-5btws"]
Oct 30 21:02:58.902727 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:58.902686    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:02:59.282201 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:59.282094    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246" event={"ID":"2a8540f7-c0cd-4778-a5aa-9665ddd8f820","Type":"ContainerDied","Data":"6ad50bfe9e90e1e3ce5626ebf4e4f2aa0da2fd13e6d71da0ea97c168b3b48e64"}
Oct 30 21:02:59.282201 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:59.282104    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"
Oct 30 21:02:59.282513 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:59.282221    4948 scope.go:122] "RemoveContainer" containerID="740a14ce9384f02a9bffe55fe8e081d22b3f28f9077397cbf1a7b202b9c9f67f"
Oct 30 21:02:59.307184 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:59.307135    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"]
Oct 30 21:02:59.313213 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:59.313175    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-65968b-f5ccd654c-df246"]
Oct 30 21:02:59.694660 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:02:59.689784    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:00.255596 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.255559    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 21:03:00.259222 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.259135    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:03:00.297155 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.297117    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:03:00.298675 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.298446    4948 generic.go:356] "Generic (PLEG): container finished" podID="77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" containerID="954a531ef719fccba0dae344c7d9f75af8b08821b4819d3a71ef81b341babdb4" exitCode=0
Oct 30 21:03:00.298675 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.298624    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"
Oct 30 21:03:00.300371 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.300328    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1a314402-a3a6-42d4-a9d3-526b464bea78" path="/var/lib/kubelet/pods/1a314402-a3a6-42d4-a9d3-526b464bea78/volumes"
Oct 30 21:03:00.300883 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.300865    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2a8540f7-c0cd-4778-a5aa-9665ddd8f820" path="/var/lib/kubelet/pods/2a8540f7-c0cd-4778-a5aa-9665ddd8f820/volumes"
Oct 30 21:03:00.305207 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.304848    4948 generic.go:356] "Generic (PLEG): container finished" podID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerID="9751b31383c92566d508e92f39e2c89e5f70fd3246382f73ff7506b077f44a89" exitCode=0
Oct 30 21:03:00.305207 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.305067    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"
Oct 30 21:03:00.306074 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.306042    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw" event={"ID":"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450","Type":"ContainerDied","Data":"954a531ef719fccba0dae344c7d9f75af8b08821b4819d3a71ef81b341babdb4"}
Oct 30 21:03:00.306454 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.306179    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw" event={"ID":"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450","Type":"ContainerDied","Data":"d5ca9569d1e76629ea56d375bad10f8aef1ccbcb5006123ccbf90effef91cf5b"}
Oct 30 21:03:00.306454 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.306207    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" event={"ID":"a93ec255-05ea-4e2e-945b-f5f360aea5cf","Type":"ContainerDied","Data":"9751b31383c92566d508e92f39e2c89e5f70fd3246382f73ff7506b077f44a89"}
Oct 30 21:03:00.306454 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.306230    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n" event={"ID":"a93ec255-05ea-4e2e-945b-f5f360aea5cf","Type":"ContainerDied","Data":"de36ae9b50ec764809a88456a1c872857c85afe9724274ee181fff19ee2f1162"}
Oct 30 21:03:00.306454 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.306329    4948 scope.go:122] "RemoveContainer" containerID="954a531ef719fccba0dae344c7d9f75af8b08821b4819d3a71ef81b341babdb4"
Oct 30 21:03:00.309173 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.308660    4948 generic.go:356] "Generic (PLEG): container finished" podID="17f8a1bb-f09d-4a66-97eb-242dd0261f2b" containerID="a26d38f6d1ef34a427533c125f61a7ec2814b3ee228a15bec390cafe0035a1b4" exitCode=0
Oct 30 21:03:00.309173 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.308778    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr" event={"ID":"17f8a1bb-f09d-4a66-97eb-242dd0261f2b","Type":"ContainerDied","Data":"a26d38f6d1ef34a427533c125f61a7ec2814b3ee228a15bec390cafe0035a1b4"}
Oct 30 21:03:00.309173 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.308827    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr" event={"ID":"17f8a1bb-f09d-4a66-97eb-242dd0261f2b","Type":"ContainerDied","Data":"f829abdaed928b358711fc3ba5a775b830b733cdf89ed50f29eafd3ef1a8344a"}
Oct 30 21:03:00.309173 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.309056    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"
Oct 30 21:03:00.311023 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.311001    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:03:00.319393 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.319334    4948 generic.go:356] "Generic (PLEG): container finished" podID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerID="389450bc2ceba606c110f277a90c9c95c898f30a85adfa028730011357421604" exitCode=0
Oct 30 21:03:00.319603 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.319437    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" event={"ID":"ad516464-a895-4e85-bd16-cf9bdcedba2d","Type":"ContainerDied","Data":"389450bc2ceba606c110f277a90c9c95c898f30a85adfa028730011357421604"}
Oct 30 21:03:00.319603 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.319490    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8" event={"ID":"ad516464-a895-4e85-bd16-cf9bdcedba2d","Type":"ContainerDied","Data":"16d382239445881f3fed6d1851169b543773c7624c5036b3219606c37b6d7578"}
Oct 30 21:03:00.324119 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.324094    4948 scope.go:122] "RemoveContainer" containerID="3b9f037d5fabdb03a2e6ccb64861c9a9be06de2b0690bbacf7bc89af308db6fd"
Oct 30 21:03:00.325476 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.325042    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-workload-certs\") pod \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") "
Oct 30 21:03:00.325622 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.325512    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istiod-ca-cert\") pod \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") "
Oct 30 21:03:00.325622 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.325557    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-workload-socket\") pod \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") "
Oct 30 21:03:00.325622 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.325606    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-token\" (UniqueName: \"kubernetes.io/projected/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-token\") pod \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") "
Oct 30 21:03:00.325802 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.325653    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-data\") pod \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") "
Oct 30 21:03:00.325802 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.325690    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-workload-certs" pod "17f8a1bb-f09d-4a66-97eb-242dd0261f2b" (UID: "17f8a1bb-f09d-4a66-97eb-242dd0261f2b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.325802 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.325700    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-token\" (UniqueName: \"kubernetes.io/projected/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-token\") pod \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") "
Oct 30 21:03:00.325802 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.325786    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-envoy\") pod \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") "
Oct 30 21:03:00.326008 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.325838    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-kube-api-access-9fngl\" (UniqueName: \"kubernetes.io/projected/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-kube-api-access-9fngl\") pod \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") "
Oct 30 21:03:00.326008 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.325891    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-token\" (UniqueName: \"kubernetes.io/projected/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-token\") pod \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") "
Oct 30 21:03:00.326008 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.325921    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-data\") pod \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") "
Oct 30 21:03:00.326167 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326022    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-credential-socket\") pod \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") "
Oct 30 21:03:00.326167 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326059    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-credential-socket\") pod \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") "
Oct 30 21:03:00.326167 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326123    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istiod-ca-cert\") pod \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") "
Oct 30 21:03:00.326331 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326177    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-workload-socket\") pod \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") "
Oct 30 21:03:00.326331 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326214    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-envoy\") pod \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") "
Oct 30 21:03:00.326331 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326256    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-workload-certs\") pod \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") "
Oct 30 21:03:00.326331 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326283    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-credential-socket\") pod \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") "
Oct 30 21:03:00.326331 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326318    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istiod-ca-cert\") pod \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") "
Oct 30 21:03:00.326681 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326350    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-data\") pod \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") "
Oct 30 21:03:00.326681 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326399    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-podinfo\") pod \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") "
Oct 30 21:03:00.326681 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326440    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-podinfo\") pod \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") "
Oct 30 21:03:00.326681 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326486    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-podinfo\") pod \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") "
Oct 30 21:03:00.326681 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326553    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a93ec255-05ea-4e2e-945b-f5f360aea5cf-kube-api-access-qqndf\" (UniqueName: \"kubernetes.io/projected/a93ec255-05ea-4e2e-945b-f5f360aea5cf-kube-api-access-qqndf\") pod \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") "
Oct 30 21:03:00.326681 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326561    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-workload-socket" pod "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" (UID: "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.326681 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326592    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-envoy\") pod \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\" (UID: \"17f8a1bb-f09d-4a66-97eb-242dd0261f2b\") "
Oct 30 21:03:00.326681 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326647    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-kube-api-access-2sgwd\" (UniqueName: \"kubernetes.io/projected/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-kube-api-access-2sgwd\") pod \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\" (UID: \"77b3e05d-d55b-4cc3-b1fb-502fd5b2b450\") "
Oct 30 21:03:00.327151 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326685    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-workload-socket\") pod \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") "
Oct 30 21:03:00.327151 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326711    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-workload-certs\") pod \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\" (UID: \"a93ec255-05ea-4e2e-945b-f5f360aea5cf\") "
Oct 30 21:03:00.327151 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326746    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-data" pod "a93ec255-05ea-4e2e-945b-f5f360aea5cf" (UID: "a93ec255-05ea-4e2e-945b-f5f360aea5cf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.327151 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326843    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-workload-socket" pod "17f8a1bb-f09d-4a66-97eb-242dd0261f2b" (UID: "17f8a1bb-f09d-4a66-97eb-242dd0261f2b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.327151 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.326934    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-credential-socket" pod "17f8a1bb-f09d-4a66-97eb-242dd0261f2b" (UID: "17f8a1bb-f09d-4a66-97eb-242dd0261f2b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.327436 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.327180    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-credential-socket" pod "a93ec255-05ea-4e2e-945b-f5f360aea5cf" (UID: "a93ec255-05ea-4e2e-945b-f5f360aea5cf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.327519 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.327497    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istiod-ca-cert" pod "17f8a1bb-f09d-4a66-97eb-242dd0261f2b" (UID: "17f8a1bb-f09d-4a66-97eb-242dd0261f2b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:00.327580 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.327544    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-data" pod "17f8a1bb-f09d-4a66-97eb-242dd0261f2b" (UID: "17f8a1bb-f09d-4a66-97eb-242dd0261f2b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.328191 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.327858    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.328191 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.327885    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.328191 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.327895    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.328191 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.327908    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.328191 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.327920    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.328191 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.327933    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.328191 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.327947    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.328191 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.327961    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.328717 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.328539    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-workload-socket" pod "a93ec255-05ea-4e2e-945b-f5f360aea5cf" (UID: "a93ec255-05ea-4e2e-945b-f5f360aea5cf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.328717 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.328644    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-workload-certs" pod "a93ec255-05ea-4e2e-945b-f5f360aea5cf" (UID: "a93ec255-05ea-4e2e-945b-f5f360aea5cf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.328791 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.328712    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-credential-socket" pod "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" (UID: "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.329495 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.329471    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istiod-ca-cert" pod "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" (UID: "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:00.330018 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.329990    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-workload-certs" pod "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" (UID: "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.330316 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.330290    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istiod-ca-cert" pod "a93ec255-05ea-4e2e-945b-f5f360aea5cf" (UID: "a93ec255-05ea-4e2e-945b-f5f360aea5cf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:00.330583 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.330559    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-data" pod "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" (UID: "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.331421 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.331381    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-token" pod "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" (UID: "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:00.331800 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.331774    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a93ec255-05ea-4e2e-945b-f5f360aea5cf-kube-api-access-qqndf" pod "a93ec255-05ea-4e2e-945b-f5f360aea5cf" (UID: "a93ec255-05ea-4e2e-945b-f5f360aea5cf"). InnerVolumeSpecName "kube-api-access-qqndf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:00.332055 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.332022    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-envoy" pod "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" (UID: "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.333222 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.333136    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-envoy" pod "a93ec255-05ea-4e2e-945b-f5f360aea5cf" (UID: "a93ec255-05ea-4e2e-945b-f5f360aea5cf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.334284 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.334102    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-envoy" pod "17f8a1bb-f09d-4a66-97eb-242dd0261f2b" (UID: "17f8a1bb-f09d-4a66-97eb-242dd0261f2b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.334284 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.334115    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-token" pod "17f8a1bb-f09d-4a66-97eb-242dd0261f2b" (UID: "17f8a1bb-f09d-4a66-97eb-242dd0261f2b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:00.334284 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.334249    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-token" pod "a93ec255-05ea-4e2e-945b-f5f360aea5cf" (UID: "a93ec255-05ea-4e2e-945b-f5f360aea5cf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:00.334284 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.334253    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-podinfo" pod "a93ec255-05ea-4e2e-945b-f5f360aea5cf" (UID: "a93ec255-05ea-4e2e-945b-f5f360aea5cf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:00.334862 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.334833    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-kube-api-access-9fngl" pod "17f8a1bb-f09d-4a66-97eb-242dd0261f2b" (UID: "17f8a1bb-f09d-4a66-97eb-242dd0261f2b"). InnerVolumeSpecName "kube-api-access-9fngl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:00.335159 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.335129    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-kube-api-access-2sgwd" pod "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" (UID: "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450"). InnerVolumeSpecName "kube-api-access-2sgwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:00.335263 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.335169    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-podinfo" pod "17f8a1bb-f09d-4a66-97eb-242dd0261f2b" (UID: "17f8a1bb-f09d-4a66-97eb-242dd0261f2b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:00.335796 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.335776    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-podinfo" pod "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" (UID: "77b3e05d-d55b-4cc3-b1fb-502fd5b2b450"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:00.347083 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.347052    4948 scope.go:122] "RemoveContainer" containerID="954a531ef719fccba0dae344c7d9f75af8b08821b4819d3a71ef81b341babdb4"
Oct 30 21:03:00.347482 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:00.347459    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"954a531ef719fccba0dae344c7d9f75af8b08821b4819d3a71ef81b341babdb4\": container with ID starting with 954a531ef719fccba0dae344c7d9f75af8b08821b4819d3a71ef81b341babdb4 not found: ID does not exist" containerID="954a531ef719fccba0dae344c7d9f75af8b08821b4819d3a71ef81b341babdb4"
Oct 30 21:03:00.347562 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.347492    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"954a531ef719fccba0dae344c7d9f75af8b08821b4819d3a71ef81b341babdb4"} err="failed to get container status \"954a531ef719fccba0dae344c7d9f75af8b08821b4819d3a71ef81b341babdb4\": rpc error: code = NotFound desc = could not find container \"954a531ef719fccba0dae344c7d9f75af8b08821b4819d3a71ef81b341babdb4\": container with ID starting with 954a531ef719fccba0dae344c7d9f75af8b08821b4819d3a71ef81b341babdb4 not found: ID does not exist"
Oct 30 21:03:00.347562 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.347510    4948 scope.go:122] "RemoveContainer" containerID="3b9f037d5fabdb03a2e6ccb64861c9a9be06de2b0690bbacf7bc89af308db6fd"
Oct 30 21:03:00.347852 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:00.347827    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b9f037d5fabdb03a2e6ccb64861c9a9be06de2b0690bbacf7bc89af308db6fd\": container with ID starting with 3b9f037d5fabdb03a2e6ccb64861c9a9be06de2b0690bbacf7bc89af308db6fd not found: ID does not exist" containerID="3b9f037d5fabdb03a2e6ccb64861c9a9be06de2b0690bbacf7bc89af308db6fd"
Oct 30 21:03:00.347908 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.347863    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b9f037d5fabdb03a2e6ccb64861c9a9be06de2b0690bbacf7bc89af308db6fd"} err="failed to get container status \"3b9f037d5fabdb03a2e6ccb64861c9a9be06de2b0690bbacf7bc89af308db6fd\": rpc error: code = NotFound desc = could not find container \"3b9f037d5fabdb03a2e6ccb64861c9a9be06de2b0690bbacf7bc89af308db6fd\": container with ID starting with 3b9f037d5fabdb03a2e6ccb64861c9a9be06de2b0690bbacf7bc89af308db6fd not found: ID does not exist"
Oct 30 21:03:00.347908 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.347881    4948 scope.go:122] "RemoveContainer" containerID="9751b31383c92566d508e92f39e2c89e5f70fd3246382f73ff7506b077f44a89"
Oct 30 21:03:00.363138 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.363110    4948 scope.go:122] "RemoveContainer" containerID="9751b31383c92566d508e92f39e2c89e5f70fd3246382f73ff7506b077f44a89"
Oct 30 21:03:00.363574 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:00.363544    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9751b31383c92566d508e92f39e2c89e5f70fd3246382f73ff7506b077f44a89\": container with ID starting with 9751b31383c92566d508e92f39e2c89e5f70fd3246382f73ff7506b077f44a89 not found: ID does not exist" containerID="9751b31383c92566d508e92f39e2c89e5f70fd3246382f73ff7506b077f44a89"
Oct 30 21:03:00.363701 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.363603    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9751b31383c92566d508e92f39e2c89e5f70fd3246382f73ff7506b077f44a89"} err="failed to get container status \"9751b31383c92566d508e92f39e2c89e5f70fd3246382f73ff7506b077f44a89\": rpc error: code = NotFound desc = could not find container \"9751b31383c92566d508e92f39e2c89e5f70fd3246382f73ff7506b077f44a89\": container with ID starting with 9751b31383c92566d508e92f39e2c89e5f70fd3246382f73ff7506b077f44a89 not found: ID does not exist"
Oct 30 21:03:00.363701 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.363631    4948 scope.go:122] "RemoveContainer" containerID="a26d38f6d1ef34a427533c125f61a7ec2814b3ee228a15bec390cafe0035a1b4"
Oct 30 21:03:00.383299 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.379815    4948 scope.go:122] "RemoveContainer" containerID="a26d38f6d1ef34a427533c125f61a7ec2814b3ee228a15bec390cafe0035a1b4"
Oct 30 21:03:00.383407 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:00.383285    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a26d38f6d1ef34a427533c125f61a7ec2814b3ee228a15bec390cafe0035a1b4\": container with ID starting with a26d38f6d1ef34a427533c125f61a7ec2814b3ee228a15bec390cafe0035a1b4 not found: ID does not exist" containerID="a26d38f6d1ef34a427533c125f61a7ec2814b3ee228a15bec390cafe0035a1b4"
Oct 30 21:03:00.383407 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.383331    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a26d38f6d1ef34a427533c125f61a7ec2814b3ee228a15bec390cafe0035a1b4"} err="failed to get container status \"a26d38f6d1ef34a427533c125f61a7ec2814b3ee228a15bec390cafe0035a1b4\": rpc error: code = NotFound desc = could not find container \"a26d38f6d1ef34a427533c125f61a7ec2814b3ee228a15bec390cafe0035a1b4\": container with ID starting with a26d38f6d1ef34a427533c125f61a7ec2814b3ee228a15bec390cafe0035a1b4 not found: ID does not exist"
Oct 30 21:03:00.383407 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.383405    4948 scope.go:122] "RemoveContainer" containerID="389450bc2ceba606c110f277a90c9c95c898f30a85adfa028730011357421604"
Oct 30 21:03:00.397857 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.397788    4948 scope.go:122] "RemoveContainer" containerID="389450bc2ceba606c110f277a90c9c95c898f30a85adfa028730011357421604"
Oct 30 21:03:00.398256 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:00.398237    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"389450bc2ceba606c110f277a90c9c95c898f30a85adfa028730011357421604\": container with ID starting with 389450bc2ceba606c110f277a90c9c95c898f30a85adfa028730011357421604 not found: ID does not exist" containerID="389450bc2ceba606c110f277a90c9c95c898f30a85adfa028730011357421604"
Oct 30 21:03:00.398350 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.398268    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389450bc2ceba606c110f277a90c9c95c898f30a85adfa028730011357421604"} err="failed to get container status \"389450bc2ceba606c110f277a90c9c95c898f30a85adfa028730011357421604\": rpc error: code = NotFound desc = could not find container \"389450bc2ceba606c110f277a90c9c95c898f30a85adfa028730011357421604\": container with ID starting with 389450bc2ceba606c110f277a90c9c95c898f30a85adfa028730011357421604 not found: ID does not exist"
Oct 30 21:03:00.428788 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.428746    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-envoy\") pod \"ad516464-a895-4e85-bd16-cf9bdcedba2d\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") "
Oct 30 21:03:00.429537 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.428832    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-podinfo\") pod \"ad516464-a895-4e85-bd16-cf9bdcedba2d\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") "
Oct 30 21:03:00.429537 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.428872    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ad516464-a895-4e85-bd16-cf9bdcedba2d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad516464-a895-4e85-bd16-cf9bdcedba2d-istiod-ca-cert\") pod \"ad516464-a895-4e85-bd16-cf9bdcedba2d\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") "
Oct 30 21:03:00.429537 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.428961    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-token\" (UniqueName: \"kubernetes.io/projected/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-token\") pod \"ad516464-a895-4e85-bd16-cf9bdcedba2d\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") "
Oct 30 21:03:00.429537 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.428999    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad516464-a895-4e85-bd16-cf9bdcedba2d-kube-api-access-mhsdc\" (UniqueName: \"kubernetes.io/projected/ad516464-a895-4e85-bd16-cf9bdcedba2d-kube-api-access-mhsdc\") pod \"ad516464-a895-4e85-bd16-cf9bdcedba2d\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") "
Oct 30 21:03:00.429537 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.429142    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-workload-certs\") pod \"ad516464-a895-4e85-bd16-cf9bdcedba2d\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") "
Oct 30 21:03:00.429537 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.429207    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-credential-socket\") pod \"ad516464-a895-4e85-bd16-cf9bdcedba2d\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") "
Oct 30 21:03:00.429537 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.429241    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-workload-socket\") pod \"ad516464-a895-4e85-bd16-cf9bdcedba2d\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") "
Oct 30 21:03:00.429537 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.429315    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad516464-a895-4e85-bd16-cf9bdcedba2d-istiod-ca-cert" pod "ad516464-a895-4e85-bd16-cf9bdcedba2d" (UID: "ad516464-a895-4e85-bd16-cf9bdcedba2d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:00.429537 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.429450    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-data\") pod \"ad516464-a895-4e85-bd16-cf9bdcedba2d\" (UID: \"ad516464-a895-4e85-bd16-cf9bdcedba2d\") "
Oct 30 21:03:00.430469 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430439    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430583 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430473    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430583 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430492    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430583 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430506    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430583 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430521    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fngl\" (UniqueName: \"kubernetes.io/projected/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-kube-api-access-9fngl\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430583 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430534    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430583 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430550    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad516464-a895-4e85-bd16-cf9bdcedba2d-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430583 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430564    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430583 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430575    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430588    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430601    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430614    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430629    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430641    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430654    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a93ec255-05ea-4e2e-945b-f5f360aea5cf-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430668    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqndf\" (UniqueName: \"kubernetes.io/projected/a93ec255-05ea-4e2e-945b-f5f360aea5cf-kube-api-access-qqndf\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430683    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17f8a1bb-f09d-4a66-97eb-242dd0261f2b-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430697    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sgwd\" (UniqueName: \"kubernetes.io/projected/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450-kube-api-access-2sgwd\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430711    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.430979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.430726    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a93ec255-05ea-4e2e-945b-f5f360aea5cf-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.431557 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.431478    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-data" pod "ad516464-a895-4e85-bd16-cf9bdcedba2d" (UID: "ad516464-a895-4e85-bd16-cf9bdcedba2d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.432111 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.431711    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-workload-socket" pod "ad516464-a895-4e85-bd16-cf9bdcedba2d" (UID: "ad516464-a895-4e85-bd16-cf9bdcedba2d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.432111 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.431980    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-workload-certs" pod "ad516464-a895-4e85-bd16-cf9bdcedba2d" (UID: "ad516464-a895-4e85-bd16-cf9bdcedba2d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.432111 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.432077    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-credential-socket" pod "ad516464-a895-4e85-bd16-cf9bdcedba2d" (UID: "ad516464-a895-4e85-bd16-cf9bdcedba2d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.432425 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.432396    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-podinfo" pod "ad516464-a895-4e85-bd16-cf9bdcedba2d" (UID: "ad516464-a895-4e85-bd16-cf9bdcedba2d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:00.432936 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.432911    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-token" pod "ad516464-a895-4e85-bd16-cf9bdcedba2d" (UID: "ad516464-a895-4e85-bd16-cf9bdcedba2d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:00.433745 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.433718    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-envoy" pod "ad516464-a895-4e85-bd16-cf9bdcedba2d" (UID: "ad516464-a895-4e85-bd16-cf9bdcedba2d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.433935 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.433917    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad516464-a895-4e85-bd16-cf9bdcedba2d-kube-api-access-mhsdc" pod "ad516464-a895-4e85-bd16-cf9bdcedba2d" (UID: "ad516464-a895-4e85-bd16-cf9bdcedba2d"). InnerVolumeSpecName "kube-api-access-mhsdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:00.505987 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.505890    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:00.532280 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.532235    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.532280 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.532273    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.532280 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.532286    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhsdc\" (UniqueName: \"kubernetes.io/projected/ad516464-a895-4e85-bd16-cf9bdcedba2d-kube-api-access-mhsdc\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.532584 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.532298    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.532584 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.532309    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.532584 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.532318    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.532584 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.532328    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.532584 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.532337    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad516464-a895-4e85-bd16-cf9bdcedba2d-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.696627 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.690899    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"]
Oct 30 21:03:00.706659 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.706579    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-vt8bw"]
Oct 30 21:03:00.740338 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.740199    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"]
Oct 30 21:03:00.744657 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.744610    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p558n"]
Oct 30 21:03:00.747684 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.747654    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"]
Oct 30 21:03:00.751017 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:00.750981    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-fpmzr"]
Oct 30 21:03:01.375206 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:01.375112    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"
Oct 30 21:03:01.410091 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:01.400164    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:01.432249 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:01.432206    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"]
Oct 30 21:03:01.435887 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:01.435853    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-48tz8"]
Oct 30 21:03:01.910195 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:01.910160    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:02.271967 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:02.271866    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:02.296118 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:02.296085    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="17f8a1bb-f09d-4a66-97eb-242dd0261f2b" path="/var/lib/kubelet/pods/17f8a1bb-f09d-4a66-97eb-242dd0261f2b/volumes"
Oct 30 21:03:02.296801 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:02.296777    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" path="/var/lib/kubelet/pods/77b3e05d-d55b-4cc3-b1fb-502fd5b2b450/volumes"
Oct 30 21:03:02.297324 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:02.297306    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" path="/var/lib/kubelet/pods/a93ec255-05ea-4e2e-945b-f5f360aea5cf/volumes"
Oct 30 21:03:02.298231 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:02.298213    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" path="/var/lib/kubelet/pods/ad516464-a895-4e85-bd16-cf9bdcedba2d/volumes"
Oct 30 21:03:02.844836 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:02.844792    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:03.054466 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:03.054348    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:03.264674 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:03.264548    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:03.521444 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:03.517235    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:03.883083 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:03.883036    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"]
Oct 30 21:03:03.883371 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:03.883323    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7" podUID="f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32" containerName="maas-api" containerID="cri-o://c4fe9122710a62c7859fc555d23eb918f452661678e1964b52bb6389664a03c7" gracePeriod=30
Oct 30 21:03:04.104336 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.104301    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:04.455142 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.455068    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:04.461759 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.461610    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 21:03:04.728385 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.725462    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-kube-api-access-jg4tf\" (UniqueName: \"kubernetes.io/projected/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-kube-api-access-jg4tf\") pod \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\" (UID: \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\") "
Oct 30 21:03:04.776388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.729559    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-maas-api-tls\") pod \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\" (UID: \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\") "
Oct 30 21:03:04.776388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.729763    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-openshift-service-ca\") pod \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\" (UID: \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\") "
Oct 30 21:03:04.776388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.729830    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-metrics-certs\") pod \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\" (UID: \"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32\") "
Oct 30 21:03:04.789012 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.788409    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-openshift-service-ca" pod "f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32" (UID: "f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:04.850384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.813828    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-kube-api-access-jg4tf" pod "f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32" (UID: "f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32"). InnerVolumeSpecName "kube-api-access-jg4tf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:04.991452 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.886904    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:04.991452 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.888140    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg4tf\" (UniqueName: \"kubernetes.io/projected/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-kube-api-access-jg4tf\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:04.991452 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.888174    4948 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-openshift-service-ca\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:04.991452 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.905669    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-metrics-certs" pod "f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32" (UID: "f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:04.991452 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.937504    4948 generic.go:356] "Generic (PLEG): container finished" podID="f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32" containerID="c4fe9122710a62c7859fc555d23eb918f452661678e1964b52bb6389664a03c7" exitCode=0
Oct 30 21:03:04.991452 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.937845    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7" event={"ID":"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32","Type":"ContainerDied","Data":"c4fe9122710a62c7859fc555d23eb918f452661678e1964b52bb6389664a03c7"}
Oct 30 21:03:04.991452 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.937963    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7" event={"ID":"f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32","Type":"ContainerDied","Data":"5be75cdbae0bc66adf88809b34a688c3d6804bdf90881184bb1eb9c0c4d847e5"}
Oct 30 21:03:04.991452 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.938002    4948 scope.go:122] "RemoveContainer" containerID="c4fe9122710a62c7859fc555d23eb918f452661678e1964b52bb6389664a03c7"
Oct 30 21:03:04.991452 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.938225    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"
Oct 30 21:03:04.991452 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:04.973866    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-maas-api-tls" pod "f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32" (UID: "f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:05.026581 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:05.026172    4948 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-maas-api-tls\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:05.026581 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:05.026209    4948 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32-metrics-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:05.129643 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:05.129594    4948 scope.go:122] "RemoveContainer" containerID="c4fe9122710a62c7859fc555d23eb918f452661678e1964b52bb6389664a03c7"
Oct 30 21:03:05.165599 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:05.165551    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4fe9122710a62c7859fc555d23eb918f452661678e1964b52bb6389664a03c7\": container with ID starting with c4fe9122710a62c7859fc555d23eb918f452661678e1964b52bb6389664a03c7 not found: ID does not exist" containerID="c4fe9122710a62c7859fc555d23eb918f452661678e1964b52bb6389664a03c7"
Oct 30 21:03:05.165928 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:05.165877    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4fe9122710a62c7859fc555d23eb918f452661678e1964b52bb6389664a03c7"} err="failed to get container status \"c4fe9122710a62c7859fc555d23eb918f452661678e1964b52bb6389664a03c7\": rpc error: code = NotFound desc = could not find container \"c4fe9122710a62c7859fc555d23eb918f452661678e1964b52bb6389664a03c7\": container with ID starting with c4fe9122710a62c7859fc555d23eb918f452661678e1964b52bb6389664a03c7 not found: ID does not exist"
Oct 30 21:03:05.249533 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:05.249430    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"]
Oct 30 21:03:05.320557 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:05.320516    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-5a8f94-66ff659f8c-5zdq7"]
Oct 30 21:03:05.344388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:05.340716    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:05.880608 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:05.880569    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:06.125388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:06.113043    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:06.345129 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:06.345090    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32" path="/var/lib/kubelet/pods/f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32/volumes"
Oct 30 21:03:06.495249 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:06.495210    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:07.045388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.032644    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:07.165444 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.165395    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"]
Oct 30 21:03:07.165760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.165721    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr" podUID="7123b746-4253-4381-8585-b0090b9fbb22" containerName="istio-proxy" containerID="cri-o://8b64def5a3755becf1835bc708c3e7b1af4b8e3f32622256c7792e0be5aca8ec" gracePeriod=30
Oct 30 21:03:07.286387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.282784    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:03:07.286387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.282885    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t" podUID="0141b4ff-f223-4fed-be7e-16f2e33ec90a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:03:07.488617 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.488575    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"]
Oct 30 21:03:07.542389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.532714    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"]
Oct 30 21:03:07.542389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.532775    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"]
Oct 30 21:03:07.542389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.533023    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerName="istio-proxy" containerID="cri-o://ec49cc49b15415ea95e8977140356df3a7cabb7b12b7d97c17a6c98db43a0e2e" gracePeriod=30
Oct 30 21:03:07.542389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.506414    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:07.542389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.533481    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4" podUID="755c4a92-3dbc-4c53-9c9e-3092071391cd" containerName="istio-proxy" containerID="cri-o://f307609e370e2f5cda52a890095b23cead1cad1ce04dcf26b1b5150d203e5bc9" gracePeriod=30
Oct 30 21:03:07.542389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.533690    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw" podUID="ec5914af-5cdd-425a-a0d3-9b6ba2947947" containerName="istio-proxy" containerID="cri-o://0291f38cd5bb8b5194626bedac9b86738af8cb730807416687f5b428d63248e9" gracePeriod=30
Oct 30 21:03:07.612388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.611946    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"]
Oct 30 21:03:07.637388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.612217    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f" podUID="00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" containerName="istio-proxy" containerID="cri-o://954929a629d4f1a2d36bae649812c5ba0b454c46552e898e67aef9223c7e86bc" gracePeriod=30
Oct 30 21:03:07.637388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.615640    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"]
Oct 30 21:03:07.637388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.615900    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk" podUID="24dd0839-321b-426a-a667-42b366bba980" containerName="istio-proxy" containerID="cri-o://d627d6fa3cd7ceeb9df8d07ed0780750b788a0472db8441612217ab8577ed286" gracePeriod=30
Oct 30 21:03:07.637388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.627435    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"]
Oct 30 21:03:07.637388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.627797    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy" containerID="cri-o://59094c9183b9652a65943cfbc77087db932aa428dd39f79fdfd3e00fba60a34e" gracePeriod=30
Oct 30 21:03:07.648172 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.648121    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"]
Oct 30 21:03:07.648795 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.648744    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy" containerID="cri-o://f8e91bf581e61ef72c68706200a3ba7b3193943bd926d3a936fdb372a30d997b" gracePeriod=30
Oct 30 21:03:07.854472 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:07.854421    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:08.514984 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:08.514943    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:09.539621 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:09.539574    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:10.448581 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:10.448536    4948 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:03:10.448771 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:10.448615    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:03:10.705844 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:10.705741    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:11.875972 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:11.875932    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:12.454243 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.454213    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:03:12.510214 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.507684    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-workload-socket\") pod \"7123b746-4253-4381-8585-b0090b9fbb22\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") "
Oct 30 21:03:12.510214 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.507741    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7123b746-4253-4381-8585-b0090b9fbb22-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7123b746-4253-4381-8585-b0090b9fbb22-istio-podinfo\") pod \"7123b746-4253-4381-8585-b0090b9fbb22\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") "
Oct 30 21:03:12.510214 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.507815    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7123b746-4253-4381-8585-b0090b9fbb22-istio-token\" (UniqueName: \"kubernetes.io/projected/7123b746-4253-4381-8585-b0090b9fbb22-istio-token\") pod \"7123b746-4253-4381-8585-b0090b9fbb22\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") "
Oct 30 21:03:12.510214 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.507859    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-istio-data\") pod \"7123b746-4253-4381-8585-b0090b9fbb22\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") "
Oct 30 21:03:12.510214 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.507891    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-credential-socket\") pod \"7123b746-4253-4381-8585-b0090b9fbb22\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") "
Oct 30 21:03:12.510214 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.507982    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-istio-envoy\") pod \"7123b746-4253-4381-8585-b0090b9fbb22\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") "
Oct 30 21:03:12.510214 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.508037    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-workload-certs\") pod \"7123b746-4253-4381-8585-b0090b9fbb22\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") "
Oct 30 21:03:12.510214 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.508102    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7123b746-4253-4381-8585-b0090b9fbb22-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7123b746-4253-4381-8585-b0090b9fbb22-istiod-ca-cert\") pod \"7123b746-4253-4381-8585-b0090b9fbb22\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") "
Oct 30 21:03:12.510214 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.508218    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7123b746-4253-4381-8585-b0090b9fbb22-kube-api-access-7hpt9\" (UniqueName: \"kubernetes.io/projected/7123b746-4253-4381-8585-b0090b9fbb22-kube-api-access-7hpt9\") pod \"7123b746-4253-4381-8585-b0090b9fbb22\" (UID: \"7123b746-4253-4381-8585-b0090b9fbb22\") "
Oct 30 21:03:12.519050 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.518981    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-istio-data" pod "7123b746-4253-4381-8585-b0090b9fbb22" (UID: "7123b746-4253-4381-8585-b0090b9fbb22"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.519277 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.519084    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-workload-certs" pod "7123b746-4253-4381-8585-b0090b9fbb22" (UID: "7123b746-4253-4381-8585-b0090b9fbb22"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.519446 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.518996    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-credential-socket" pod "7123b746-4253-4381-8585-b0090b9fbb22" (UID: "7123b746-4253-4381-8585-b0090b9fbb22"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.519558 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.519523    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-workload-socket" pod "7123b746-4253-4381-8585-b0090b9fbb22" (UID: "7123b746-4253-4381-8585-b0090b9fbb22"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.519968 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.519946    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7123b746-4253-4381-8585-b0090b9fbb22-istiod-ca-cert" pod "7123b746-4253-4381-8585-b0090b9fbb22" (UID: "7123b746-4253-4381-8585-b0090b9fbb22"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:12.522167 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.522134    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-istio-envoy" pod "7123b746-4253-4381-8585-b0090b9fbb22" (UID: "7123b746-4253-4381-8585-b0090b9fbb22"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.522278 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.522152    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7123b746-4253-4381-8585-b0090b9fbb22-istio-podinfo" pod "7123b746-4253-4381-8585-b0090b9fbb22" (UID: "7123b746-4253-4381-8585-b0090b9fbb22"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:12.522507 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.522484    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7123b746-4253-4381-8585-b0090b9fbb22-istio-token" pod "7123b746-4253-4381-8585-b0090b9fbb22" (UID: "7123b746-4253-4381-8585-b0090b9fbb22"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:12.522837 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.522816    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7123b746-4253-4381-8585-b0090b9fbb22-kube-api-access-7hpt9" pod "7123b746-4253-4381-8585-b0090b9fbb22" (UID: "7123b746-4253-4381-8585-b0090b9fbb22"). InnerVolumeSpecName "kube-api-access-7hpt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:12.540608 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.540572    4948 generic.go:356] "Generic (PLEG): container finished" podID="7123b746-4253-4381-8585-b0090b9fbb22" containerID="8b64def5a3755becf1835bc708c3e7b1af4b8e3f32622256c7792e0be5aca8ec" exitCode=0
Oct 30 21:03:12.540787 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.540636    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"
Oct 30 21:03:12.540787 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.540637    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr" event={"ID":"7123b746-4253-4381-8585-b0090b9fbb22","Type":"ContainerDied","Data":"8b64def5a3755becf1835bc708c3e7b1af4b8e3f32622256c7792e0be5aca8ec"}
Oct 30 21:03:12.540902 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.540803    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr" event={"ID":"7123b746-4253-4381-8585-b0090b9fbb22","Type":"ContainerDied","Data":"1f0ae5de14f8a24a0365b1c385afaafed45f24b87554cb3e0fa605855f25bb52"}
Oct 30 21:03:12.540902 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.540839    4948 scope.go:122] "RemoveContainer" containerID="8b64def5a3755becf1835bc708c3e7b1af4b8e3f32622256c7792e0be5aca8ec"
Oct 30 21:03:12.551550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.551528    4948 scope.go:122] "RemoveContainer" containerID="8b64def5a3755becf1835bc708c3e7b1af4b8e3f32622256c7792e0be5aca8ec"
Oct 30 21:03:12.551928 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:12.551904    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b64def5a3755becf1835bc708c3e7b1af4b8e3f32622256c7792e0be5aca8ec\": container with ID starting with 8b64def5a3755becf1835bc708c3e7b1af4b8e3f32622256c7792e0be5aca8ec not found: ID does not exist" containerID="8b64def5a3755becf1835bc708c3e7b1af4b8e3f32622256c7792e0be5aca8ec"
Oct 30 21:03:12.551982 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.551939    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b64def5a3755becf1835bc708c3e7b1af4b8e3f32622256c7792e0be5aca8ec"} err="failed to get container status \"8b64def5a3755becf1835bc708c3e7b1af4b8e3f32622256c7792e0be5aca8ec\": rpc error: code = NotFound desc = could not find container \"8b64def5a3755becf1835bc708c3e7b1af4b8e3f32622256c7792e0be5aca8ec\": container with ID starting with 8b64def5a3755becf1835bc708c3e7b1af4b8e3f32622256c7792e0be5aca8ec not found: ID does not exist"
Oct 30 21:03:12.612035 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.611978    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.612035 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.612019    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7123b746-4253-4381-8585-b0090b9fbb22-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.612035 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.612033    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7123b746-4253-4381-8585-b0090b9fbb22-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.612337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.612046    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.612337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.612060    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.612337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.612072    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.612337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.612085    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7123b746-4253-4381-8585-b0090b9fbb22-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.612337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.612098    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7123b746-4253-4381-8585-b0090b9fbb22-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.612337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.612112    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hpt9\" (UniqueName: \"kubernetes.io/projected/7123b746-4253-4381-8585-b0090b9fbb22-kube-api-access-7hpt9\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.612981 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.612838    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"]
Oct 30 21:03:12.619449 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.619412    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-b9zmr"]
Oct 30 21:03:12.924764 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.924511    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:03:12.977201 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.977157    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:03:12.997195 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:12.997144    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:13.030766 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.030683    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-data\") pod \"29bd5543-e7f6-4989-877b-47efbbc7ab19\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") "
Oct 30 21:03:13.030766 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.030736    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-envoy\") pod \"29bd5543-e7f6-4989-877b-47efbbc7ab19\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") "
Oct 30 21:03:13.031015 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.030789    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-credential-socket\") pod \"29bd5543-e7f6-4989-877b-47efbbc7ab19\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") "
Oct 30 21:03:13.031015 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.030897    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29bd5543-e7f6-4989-877b-47efbbc7ab19-kube-api-access-wbvz9\" (UniqueName: \"kubernetes.io/projected/29bd5543-e7f6-4989-877b-47efbbc7ab19-kube-api-access-wbvz9\") pod \"29bd5543-e7f6-4989-877b-47efbbc7ab19\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") "
Oct 30 21:03:13.031015 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.030933    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-workload-socket\") pod \"29bd5543-e7f6-4989-877b-47efbbc7ab19\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") "
Oct 30 21:03:13.031015 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.030953    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-data" pod "29bd5543-e7f6-4989-877b-47efbbc7ab19" (UID: "29bd5543-e7f6-4989-877b-47efbbc7ab19"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.031015 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.030977    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/29bd5543-e7f6-4989-877b-47efbbc7ab19-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29bd5543-e7f6-4989-877b-47efbbc7ab19-istiod-ca-cert\") pod \"29bd5543-e7f6-4989-877b-47efbbc7ab19\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") "
Oct 30 21:03:13.031331 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.031064    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-token\" (UniqueName: \"kubernetes.io/projected/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-token\") pod \"29bd5543-e7f6-4989-877b-47efbbc7ab19\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") "
Oct 30 21:03:13.031331 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.031148    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-podinfo\") pod \"29bd5543-e7f6-4989-877b-47efbbc7ab19\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") "
Oct 30 21:03:13.031331 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.031182    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-workload-certs\") pod \"29bd5543-e7f6-4989-877b-47efbbc7ab19\" (UID: \"29bd5543-e7f6-4989-877b-47efbbc7ab19\") "
Oct 30 21:03:13.031331 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.031221    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-credential-socket" pod "29bd5543-e7f6-4989-877b-47efbbc7ab19" (UID: "29bd5543-e7f6-4989-877b-47efbbc7ab19"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.031794 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.031769    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.031895 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.031801    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.032033 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.031954    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29bd5543-e7f6-4989-877b-47efbbc7ab19-istiod-ca-cert" pod "29bd5543-e7f6-4989-877b-47efbbc7ab19" (UID: "29bd5543-e7f6-4989-877b-47efbbc7ab19"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:13.032104 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.032026    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-workload-certs" pod "29bd5543-e7f6-4989-877b-47efbbc7ab19" (UID: "29bd5543-e7f6-4989-877b-47efbbc7ab19"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.033663 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.033609    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-workload-socket" pod "29bd5543-e7f6-4989-877b-47efbbc7ab19" (UID: "29bd5543-e7f6-4989-877b-47efbbc7ab19"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.038715 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.035991    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-token" pod "29bd5543-e7f6-4989-877b-47efbbc7ab19" (UID: "29bd5543-e7f6-4989-877b-47efbbc7ab19"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.038715 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.037901    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-podinfo" pod "29bd5543-e7f6-4989-877b-47efbbc7ab19" (UID: "29bd5543-e7f6-4989-877b-47efbbc7ab19"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:13.038715 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.038293    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29bd5543-e7f6-4989-877b-47efbbc7ab19-kube-api-access-wbvz9" pod "29bd5543-e7f6-4989-877b-47efbbc7ab19" (UID: "29bd5543-e7f6-4989-877b-47efbbc7ab19"). InnerVolumeSpecName "kube-api-access-wbvz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.048015 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.047627    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 21:03:13.053902 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.053841    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-envoy" pod "29bd5543-e7f6-4989-877b-47efbbc7ab19" (UID: "29bd5543-e7f6-4989-877b-47efbbc7ab19"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.110471 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.110085    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:03:13.132454 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.132417    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-token\" (UniqueName: \"kubernetes.io/projected/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-token\") pod \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") "
Oct 30 21:03:13.132768 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.132745    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-data\") pod \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") "
Oct 30 21:03:13.132923 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.132906    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-kube-api-access-2gqk5\" (UniqueName: \"kubernetes.io/projected/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-kube-api-access-2gqk5\") pod \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") "
Oct 30 21:03:13.133047 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.133032    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-data\") pod \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") "
Oct 30 21:03:13.133210 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.133195    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-podinfo\") pod \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") "
Oct 30 21:03:13.133419 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.133337    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-workload-certs\") pod \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") "
Oct 30 21:03:13.133683 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.133663    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-envoy\") pod \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") "
Oct 30 21:03:13.133838 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.133818    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ec5914af-5cdd-425a-a0d3-9b6ba2947947-kube-api-access-5gf7g\" (UniqueName: \"kubernetes.io/projected/ec5914af-5cdd-425a-a0d3-9b6ba2947947-kube-api-access-5gf7g\") pod \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") "
Oct 30 21:03:13.133972 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.133957    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-podinfo\") pod \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") "
Oct 30 21:03:13.134099 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.134080    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-token\" (UniqueName: \"kubernetes.io/projected/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-token\") pod \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") "
Oct 30 21:03:13.134237 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.134222    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istiod-ca-cert\") pod \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") "
Oct 30 21:03:13.134382 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.134344    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-workload-socket\") pod \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") "
Oct 30 21:03:13.134569 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.134552    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-workload-socket\") pod \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") "
Oct 30 21:03:13.134705 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.134689    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-envoy\") pod \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") "
Oct 30 21:03:13.134850 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.134833    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-credential-socket\") pod \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") "
Oct 30 21:03:13.134973 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.134958    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istiod-ca-cert\") pod \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\" (UID: \"ec5914af-5cdd-425a-a0d3-9b6ba2947947\") "
Oct 30 21:03:13.135113 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.135099    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-credential-socket\") pod \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") "
Oct 30 21:03:13.135225 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.135212    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-workload-certs\") pod \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\" (UID: \"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54\") "
Oct 30 21:03:13.138415 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.134252    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-data" pod "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" (UID: "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.138415 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.136061    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-workload-socket" pod "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" (UID: "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.138415 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.136443    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istiod-ca-cert" pod "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" (UID: "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:13.138415 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.136870    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-workload-socket" pod "ec5914af-5cdd-425a-a0d3-9b6ba2947947" (UID: "ec5914af-5cdd-425a-a0d3-9b6ba2947947"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.138415 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.137325    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-credential-socket" pod "ec5914af-5cdd-425a-a0d3-9b6ba2947947" (UID: "ec5914af-5cdd-425a-a0d3-9b6ba2947947"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.138415 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.137503    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istiod-ca-cert" pod "ec5914af-5cdd-425a-a0d3-9b6ba2947947" (UID: "ec5914af-5cdd-425a-a0d3-9b6ba2947947"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:13.138415 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.138057    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-credential-socket" pod "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" (UID: "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.139422 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.139383    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-workload-certs" pod "ec5914af-5cdd-425a-a0d3-9b6ba2947947" (UID: "ec5914af-5cdd-425a-a0d3-9b6ba2947947"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.140739 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.140415    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 21:03:13.141346 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.140884    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-data" pod "ec5914af-5cdd-425a-a0d3-9b6ba2947947" (UID: "ec5914af-5cdd-425a-a0d3-9b6ba2947947"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.144760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.142844    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29bd5543-e7f6-4989-877b-47efbbc7ab19-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.144760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.142876    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.144760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.142894    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.144760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.142909    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.144760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.142925    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.144760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.142943    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.144760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.142958    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.144760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.142975    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.144760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.142990    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.144760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.143005    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.144760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.143022    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.144760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.143038    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.144760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.143053    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.144760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.143068    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.144760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.143084    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbvz9\" (UniqueName: \"kubernetes.io/projected/29bd5543-e7f6-4989-877b-47efbbc7ab19-kube-api-access-wbvz9\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.144760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.143100    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29bd5543-e7f6-4989-877b-47efbbc7ab19-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.144760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.143319    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-workload-certs" pod "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" (UID: "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.150927 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.150863    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-podinfo" pod "ec5914af-5cdd-425a-a0d3-9b6ba2947947" (UID: "ec5914af-5cdd-425a-a0d3-9b6ba2947947"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:13.151205 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.151180    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:03:13.151392 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.151265    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-podinfo" pod "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" (UID: "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:13.152039 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.151997    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-envoy" pod "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" (UID: "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.152039 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.152014    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec5914af-5cdd-425a-a0d3-9b6ba2947947-kube-api-access-5gf7g" pod "ec5914af-5cdd-425a-a0d3-9b6ba2947947" (UID: "ec5914af-5cdd-425a-a0d3-9b6ba2947947"). InnerVolumeSpecName "kube-api-access-5gf7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.152867 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.152839    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-token" pod "ec5914af-5cdd-425a-a0d3-9b6ba2947947" (UID: "ec5914af-5cdd-425a-a0d3-9b6ba2947947"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.153249 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.153227    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-token" pod "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" (UID: "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.153470 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.153448    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-envoy" pod "ec5914af-5cdd-425a-a0d3-9b6ba2947947" (UID: "ec5914af-5cdd-425a-a0d3-9b6ba2947947"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.153554 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.153536    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-kube-api-access-2gqk5" pod "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" (UID: "00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54"). InnerVolumeSpecName "kube-api-access-2gqk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.243968 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.243927    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-workload-socket\") pod \"24dd0839-321b-426a-a667-42b366bba980\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") "
Oct 30 21:03:13.244186 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.243990    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-podinfo\") pod \"aad11c1f-9bd6-4268-9759-2589245b9a91\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") "
Oct 30 21:03:13.244186 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244023    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-credential-socket\") pod \"aad11c1f-9bd6-4268-9759-2589245b9a91\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") "
Oct 30 21:03:13.244186 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244075    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-data\") pod \"aad11c1f-9bd6-4268-9759-2589245b9a91\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") "
Oct 30 21:03:13.244186 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244108    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-workload-certs\") pod \"459a9978-d5ae-419b-a4c2-ebfa6078326d\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") "
Oct 30 21:03:13.244186 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244139    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/24dd0839-321b-426a-a667-42b366bba980-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24dd0839-321b-426a-a667-42b366bba980-istio-podinfo\") pod \"24dd0839-321b-426a-a667-42b366bba980\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") "
Oct 30 21:03:13.244186 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244172    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-data\") pod \"459a9978-d5ae-419b-a4c2-ebfa6078326d\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") "
Oct 30 21:03:13.244535 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244203    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aad11c1f-9bd6-4268-9759-2589245b9a91-kube-api-access-vh7jz\" (UniqueName: \"kubernetes.io/projected/aad11c1f-9bd6-4268-9759-2589245b9a91-kube-api-access-vh7jz\") pod \"aad11c1f-9bd6-4268-9759-2589245b9a91\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") "
Oct 30 21:03:13.244535 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244233    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-credential-socket\") pod \"459a9978-d5ae-419b-a4c2-ebfa6078326d\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") "
Oct 30 21:03:13.244535 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244266    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/24dd0839-321b-426a-a667-42b366bba980-istio-token\" (UniqueName: \"kubernetes.io/projected/24dd0839-321b-426a-a667-42b366bba980-istio-token\") pod \"24dd0839-321b-426a-a667-42b366bba980\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") "
Oct 30 21:03:13.244535 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244314    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/459a9978-d5ae-419b-a4c2-ebfa6078326d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/459a9978-d5ae-419b-a4c2-ebfa6078326d-istiod-ca-cert\") pod \"459a9978-d5ae-419b-a4c2-ebfa6078326d\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") "
Oct 30 21:03:13.244535 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244348    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-token\" (UniqueName: \"kubernetes.io/projected/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-token\") pod \"aad11c1f-9bd6-4268-9759-2589245b9a91\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") "
Oct 30 21:03:13.244535 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244349    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-workload-socket" pod "24dd0839-321b-426a-a667-42b366bba980" (UID: "24dd0839-321b-426a-a667-42b366bba980"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.244535 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244399    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-workload-socket\") pod \"aad11c1f-9bd6-4268-9759-2589245b9a91\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") "
Oct 30 21:03:13.244535 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244431    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-workload-certs\") pod \"aad11c1f-9bd6-4268-9759-2589245b9a91\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") "
Oct 30 21:03:13.244535 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244500    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/459a9978-d5ae-419b-a4c2-ebfa6078326d-kube-api-access-9mjg5\" (UniqueName: \"kubernetes.io/projected/459a9978-d5ae-419b-a4c2-ebfa6078326d-kube-api-access-9mjg5\") pod \"459a9978-d5ae-419b-a4c2-ebfa6078326d\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") "
Oct 30 21:03:13.244967 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244534    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-token\" (UniqueName: \"kubernetes.io/projected/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-token\") pod \"459a9978-d5ae-419b-a4c2-ebfa6078326d\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") "
Oct 30 21:03:13.244967 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244576    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-envoy\") pod \"aad11c1f-9bd6-4268-9759-2589245b9a91\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") "
Oct 30 21:03:13.244967 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244664    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aad11c1f-9bd6-4268-9759-2589245b9a91-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aad11c1f-9bd6-4268-9759-2589245b9a91-istiod-ca-cert\") pod \"aad11c1f-9bd6-4268-9759-2589245b9a91\" (UID: \"aad11c1f-9bd6-4268-9759-2589245b9a91\") "
Oct 30 21:03:13.244967 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244698    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-istio-data\") pod \"24dd0839-321b-426a-a667-42b366bba980\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") "
Oct 30 21:03:13.244967 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244736    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/24dd0839-321b-426a-a667-42b366bba980-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24dd0839-321b-426a-a667-42b366bba980-istiod-ca-cert\") pod \"24dd0839-321b-426a-a667-42b366bba980\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") "
Oct 30 21:03:13.244967 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244781    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-credential-socket" pod "aad11c1f-9bd6-4268-9759-2589245b9a91" (UID: "aad11c1f-9bd6-4268-9759-2589245b9a91"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.244967 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244796    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-istio-envoy\") pod \"24dd0839-321b-426a-a667-42b366bba980\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") "
Oct 30 21:03:13.244967 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244896    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-workload-certs\") pod \"24dd0839-321b-426a-a667-42b366bba980\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") "
Oct 30 21:03:13.244967 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244926    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/24dd0839-321b-426a-a667-42b366bba980-kube-api-access-jn225\" (UniqueName: \"kubernetes.io/projected/24dd0839-321b-426a-a667-42b366bba980-kube-api-access-jn225\") pod \"24dd0839-321b-426a-a667-42b366bba980\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") "
Oct 30 21:03:13.245427 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.244989    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-workload-certs" pod "459a9978-d5ae-419b-a4c2-ebfa6078326d" (UID: "459a9978-d5ae-419b-a4c2-ebfa6078326d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.245427 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.245015    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-envoy\") pod \"459a9978-d5ae-419b-a4c2-ebfa6078326d\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") "
Oct 30 21:03:13.245427 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.245070    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-credential-socket\") pod \"24dd0839-321b-426a-a667-42b366bba980\" (UID: \"24dd0839-321b-426a-a667-42b366bba980\") "
Oct 30 21:03:13.245427 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.245132    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-workload-socket\") pod \"459a9978-d5ae-419b-a4c2-ebfa6078326d\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") "
Oct 30 21:03:13.245427 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.245171    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-podinfo\") pod \"459a9978-d5ae-419b-a4c2-ebfa6078326d\" (UID: \"459a9978-d5ae-419b-a4c2-ebfa6078326d\") "
Oct 30 21:03:13.245427 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.245191    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-data" pod "459a9978-d5ae-419b-a4c2-ebfa6078326d" (UID: "459a9978-d5ae-419b-a4c2-ebfa6078326d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.245733 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.245438    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-data" pod "aad11c1f-9bd6-4268-9759-2589245b9a91" (UID: "aad11c1f-9bd6-4268-9759-2589245b9a91"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.245733 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.245591    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-credential-socket" pod "459a9978-d5ae-419b-a4c2-ebfa6078326d" (UID: "459a9978-d5ae-419b-a4c2-ebfa6078326d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.245733 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.245705    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aad11c1f-9bd6-4268-9759-2589245b9a91-istiod-ca-cert" pod "aad11c1f-9bd6-4268-9759-2589245b9a91" (UID: "aad11c1f-9bd6-4268-9759-2589245b9a91"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:13.245838 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.245801    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-workload-certs" pod "aad11c1f-9bd6-4268-9759-2589245b9a91" (UID: "aad11c1f-9bd6-4268-9759-2589245b9a91"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246091    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246114    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246125    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aad11c1f-9bd6-4268-9759-2589245b9a91-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246134    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246145    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246165    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gqk5\" (UniqueName: \"kubernetes.io/projected/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-kube-api-access-2gqk5\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246186    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246201    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246216    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246230    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246243    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246257    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gf7g\" (UniqueName: \"kubernetes.io/projected/ec5914af-5cdd-425a-a0d3-9b6ba2947947-kube-api-access-5gf7g\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246272    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246287    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246301    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246315    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec5914af-5cdd-425a-a0d3-9b6ba2947947-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246330    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246571    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-workload-socket" pod "aad11c1f-9bd6-4268-9759-2589245b9a91" (UID: "aad11c1f-9bd6-4268-9759-2589245b9a91"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246759    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-workload-certs" pod "24dd0839-321b-426a-a667-42b366bba980" (UID: "24dd0839-321b-426a-a667-42b366bba980"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.246941    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-istio-data" pod "24dd0839-321b-426a-a667-42b366bba980" (UID: "24dd0839-321b-426a-a667-42b366bba980"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.247240    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24dd0839-321b-426a-a667-42b366bba980-istiod-ca-cert" pod "24dd0839-321b-426a-a667-42b366bba980" (UID: "24dd0839-321b-426a-a667-42b366bba980"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:13.247574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.247403    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24dd0839-321b-426a-a667-42b366bba980-istio-token" pod "24dd0839-321b-426a-a667-42b366bba980" (UID: "24dd0839-321b-426a-a667-42b366bba980"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.248829 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.248220    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-podinfo" pod "459a9978-d5ae-419b-a4c2-ebfa6078326d" (UID: "459a9978-d5ae-419b-a4c2-ebfa6078326d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:13.248829 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.248506    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-credential-socket" pod "24dd0839-321b-426a-a667-42b366bba980" (UID: "24dd0839-321b-426a-a667-42b366bba980"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.248829 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.248696    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-workload-socket" pod "459a9978-d5ae-419b-a4c2-ebfa6078326d" (UID: "459a9978-d5ae-419b-a4c2-ebfa6078326d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.249459 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.249285    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/459a9978-d5ae-419b-a4c2-ebfa6078326d-kube-api-access-9mjg5" pod "459a9978-d5ae-419b-a4c2-ebfa6078326d" (UID: "459a9978-d5ae-419b-a4c2-ebfa6078326d"). InnerVolumeSpecName "kube-api-access-9mjg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.249987 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.249693    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-token" pod "aad11c1f-9bd6-4268-9759-2589245b9a91" (UID: "aad11c1f-9bd6-4268-9759-2589245b9a91"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.249987 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.249779    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/24dd0839-321b-426a-a667-42b366bba980-istio-podinfo" pod "24dd0839-321b-426a-a667-42b366bba980" (UID: "24dd0839-321b-426a-a667-42b366bba980"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:13.250151 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.250089    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/459a9978-d5ae-419b-a4c2-ebfa6078326d-istiod-ca-cert" pod "459a9978-d5ae-419b-a4c2-ebfa6078326d" (UID: "459a9978-d5ae-419b-a4c2-ebfa6078326d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:13.251567 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.251500    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-istio-envoy" pod "24dd0839-321b-426a-a667-42b366bba980" (UID: "24dd0839-321b-426a-a667-42b366bba980"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.251794 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.251771    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aad11c1f-9bd6-4268-9759-2589245b9a91-kube-api-access-vh7jz" pod "aad11c1f-9bd6-4268-9759-2589245b9a91" (UID: "aad11c1f-9bd6-4268-9759-2589245b9a91"). InnerVolumeSpecName "kube-api-access-vh7jz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.252689 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.252654    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-envoy" pod "459a9978-d5ae-419b-a4c2-ebfa6078326d" (UID: "459a9978-d5ae-419b-a4c2-ebfa6078326d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.253275 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.253130    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-podinfo" pod "aad11c1f-9bd6-4268-9759-2589245b9a91" (UID: "aad11c1f-9bd6-4268-9759-2589245b9a91"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:13.253275 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.253209    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24dd0839-321b-426a-a667-42b366bba980-kube-api-access-jn225" pod "24dd0839-321b-426a-a667-42b366bba980" (UID: "24dd0839-321b-426a-a667-42b366bba980"). InnerVolumeSpecName "kube-api-access-jn225". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.253470 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.253293    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-envoy" pod "aad11c1f-9bd6-4268-9759-2589245b9a91" (UID: "aad11c1f-9bd6-4268-9759-2589245b9a91"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.254776 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.254727    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-token" pod "459a9978-d5ae-419b-a4c2-ebfa6078326d" (UID: "459a9978-d5ae-419b-a4c2-ebfa6078326d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.343444 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.343406    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:13.347719 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347689    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.347719 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347719    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.347863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347732    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn225\" (UniqueName: \"kubernetes.io/projected/24dd0839-321b-426a-a667-42b366bba980-kube-api-access-jn225\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.347863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347741    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.347863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347754    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.347863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347766    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/459a9978-d5ae-419b-a4c2-ebfa6078326d-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.347863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347775    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.347863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347788    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.347863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347797    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24dd0839-321b-426a-a667-42b366bba980-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.347863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347806    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh7jz\" (UniqueName: \"kubernetes.io/projected/aad11c1f-9bd6-4268-9759-2589245b9a91-kube-api-access-vh7jz\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.347863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347815    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24dd0839-321b-426a-a667-42b366bba980-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.347863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347827    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/459a9978-d5ae-419b-a4c2-ebfa6078326d-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.347863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347839    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.347863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347848    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.347863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347857    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mjg5\" (UniqueName: \"kubernetes.io/projected/459a9978-d5ae-419b-a4c2-ebfa6078326d-kube-api-access-9mjg5\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.347863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347865    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/459a9978-d5ae-419b-a4c2-ebfa6078326d-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.348269 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347877    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aad11c1f-9bd6-4268-9759-2589245b9a91-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.348269 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347887    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24dd0839-321b-426a-a667-42b366bba980-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.348269 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.347895    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24dd0839-321b-426a-a667-42b366bba980-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.362082 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.362040    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:03:13.448587 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.448547    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-podinfo\") pod \"755c4a92-3dbc-4c53-9c9e-3092071391cd\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") "
Oct 30 21:03:13.448769 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.448604    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-credential-socket\") pod \"755c4a92-3dbc-4c53-9c9e-3092071391cd\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") "
Oct 30 21:03:13.448769 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.448658    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-data\") pod \"755c4a92-3dbc-4c53-9c9e-3092071391cd\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") "
Oct 30 21:03:13.448769 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.448679    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-envoy\") pod \"755c4a92-3dbc-4c53-9c9e-3092071391cd\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") "
Oct 30 21:03:13.448769 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.448709    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-token\" (UniqueName: \"kubernetes.io/projected/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-token\") pod \"755c4a92-3dbc-4c53-9c9e-3092071391cd\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") "
Oct 30 21:03:13.448769 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.448729    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/755c4a92-3dbc-4c53-9c9e-3092071391cd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/755c4a92-3dbc-4c53-9c9e-3092071391cd-istiod-ca-cert\") pod \"755c4a92-3dbc-4c53-9c9e-3092071391cd\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") "
Oct 30 21:03:13.449084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.448772    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/755c4a92-3dbc-4c53-9c9e-3092071391cd-kube-api-access-zftwt\" (UniqueName: \"kubernetes.io/projected/755c4a92-3dbc-4c53-9c9e-3092071391cd-kube-api-access-zftwt\") pod \"755c4a92-3dbc-4c53-9c9e-3092071391cd\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") "
Oct 30 21:03:13.449084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.448886    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-credential-socket" pod "755c4a92-3dbc-4c53-9c9e-3092071391cd" (UID: "755c4a92-3dbc-4c53-9c9e-3092071391cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.449084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.448910    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-workload-socket\") pod \"755c4a92-3dbc-4c53-9c9e-3092071391cd\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") "
Oct 30 21:03:13.449084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.449017    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-workload-certs\") pod \"755c4a92-3dbc-4c53-9c9e-3092071391cd\" (UID: \"755c4a92-3dbc-4c53-9c9e-3092071391cd\") "
Oct 30 21:03:13.449300 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.449222    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-workload-socket" pod "755c4a92-3dbc-4c53-9c9e-3092071391cd" (UID: "755c4a92-3dbc-4c53-9c9e-3092071391cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.449300 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.449231    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/755c4a92-3dbc-4c53-9c9e-3092071391cd-istiod-ca-cert" pod "755c4a92-3dbc-4c53-9c9e-3092071391cd" (UID: "755c4a92-3dbc-4c53-9c9e-3092071391cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:13.449482 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.449436    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-data" pod "755c4a92-3dbc-4c53-9c9e-3092071391cd" (UID: "755c4a92-3dbc-4c53-9c9e-3092071391cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.449641 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.449624    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.449706 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.449647    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.449706 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.449662    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.449706 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.449680    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/755c4a92-3dbc-4c53-9c9e-3092071391cd-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.450192 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.450167    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-workload-certs" pod "755c4a92-3dbc-4c53-9c9e-3092071391cd" (UID: "755c4a92-3dbc-4c53-9c9e-3092071391cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.451508 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.451483    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-envoy" pod "755c4a92-3dbc-4c53-9c9e-3092071391cd" (UID: "755c4a92-3dbc-4c53-9c9e-3092071391cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.451615 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.451597    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-token" pod "755c4a92-3dbc-4c53-9c9e-3092071391cd" (UID: "755c4a92-3dbc-4c53-9c9e-3092071391cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.451668 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.451600    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-podinfo" pod "755c4a92-3dbc-4c53-9c9e-3092071391cd" (UID: "755c4a92-3dbc-4c53-9c9e-3092071391cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:13.452430 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.452397    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/755c4a92-3dbc-4c53-9c9e-3092071391cd-kube-api-access-zftwt" pod "755c4a92-3dbc-4c53-9c9e-3092071391cd" (UID: "755c4a92-3dbc-4c53-9c9e-3092071391cd"). InnerVolumeSpecName "kube-api-access-zftwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.549289 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.549247    4948 generic.go:356] "Generic (PLEG): container finished" podID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerID="ec49cc49b15415ea95e8977140356df3a7cabb7b12b7d97c17a6c98db43a0e2e" exitCode=0
Oct 30 21:03:13.549570 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.549324    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"
Oct 30 21:03:13.549570 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.549339    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" event={"ID":"29bd5543-e7f6-4989-877b-47efbbc7ab19","Type":"ContainerDied","Data":"ec49cc49b15415ea95e8977140356df3a7cabb7b12b7d97c17a6c98db43a0e2e"}
Oct 30 21:03:13.550398 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.550328    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz" event={"ID":"29bd5543-e7f6-4989-877b-47efbbc7ab19","Type":"ContainerDied","Data":"2322a97ea237c33b495a675d6a62bbcfc7b75216e015cfad6904a76c46e20887"}
Oct 30 21:03:13.550398 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.550399    4948 scope.go:122] "RemoveContainer" containerID="ec49cc49b15415ea95e8977140356df3a7cabb7b12b7d97c17a6c98db43a0e2e"
Oct 30 21:03:13.550723 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.550703    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.550797 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.550728    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.550797 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.550743    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.550797 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.550757    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/755c4a92-3dbc-4c53-9c9e-3092071391cd-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.550797 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.550773    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zftwt\" (UniqueName: \"kubernetes.io/projected/755c4a92-3dbc-4c53-9c9e-3092071391cd-kube-api-access-zftwt\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.552340 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.552316    4948 generic.go:356] "Generic (PLEG): container finished" podID="ec5914af-5cdd-425a-a0d3-9b6ba2947947" containerID="0291f38cd5bb8b5194626bedac9b86738af8cb730807416687f5b428d63248e9" exitCode=0
Oct 30 21:03:13.552485 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.552450    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw" event={"ID":"ec5914af-5cdd-425a-a0d3-9b6ba2947947","Type":"ContainerDied","Data":"0291f38cd5bb8b5194626bedac9b86738af8cb730807416687f5b428d63248e9"}
Oct 30 21:03:13.552555 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.552488    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"
Oct 30 21:03:13.552555 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.552521    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw" event={"ID":"ec5914af-5cdd-425a-a0d3-9b6ba2947947","Type":"ContainerDied","Data":"66291f1021492a359ebbf258b2d2b798146fee9b82dc0eee14923bcc3ee724ef"}
Oct 30 21:03:13.554721 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.554695    4948 generic.go:356] "Generic (PLEG): container finished" podID="24dd0839-321b-426a-a667-42b366bba980" containerID="d627d6fa3cd7ceeb9df8d07ed0780750b788a0472db8441612217ab8577ed286" exitCode=0
Oct 30 21:03:13.554841 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.554775    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk" event={"ID":"24dd0839-321b-426a-a667-42b366bba980","Type":"ContainerDied","Data":"d627d6fa3cd7ceeb9df8d07ed0780750b788a0472db8441612217ab8577ed286"}
Oct 30 21:03:13.554841 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.554823    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk" event={"ID":"24dd0839-321b-426a-a667-42b366bba980","Type":"ContainerDied","Data":"96d73fd9b5388e446daf64b799f396ad2d8ad4189485308fc54096883187d87f"}
Oct 30 21:03:13.554950 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.554904    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"
Oct 30 21:03:13.561470 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.561028    4948 generic.go:356] "Generic (PLEG): container finished" podID="00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" containerID="954929a629d4f1a2d36bae649812c5ba0b454c46552e898e67aef9223c7e86bc" exitCode=0
Oct 30 21:03:13.561470 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.561128    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"
Oct 30 21:03:13.561470 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.561167    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f" event={"ID":"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54","Type":"ContainerDied","Data":"954929a629d4f1a2d36bae649812c5ba0b454c46552e898e67aef9223c7e86bc"}
Oct 30 21:03:13.561470 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.561216    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f" event={"ID":"00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54","Type":"ContainerDied","Data":"1b06aa1a64493a9293f1a83c434dcb93ffeec4fa0bd9d433e7f893c34d61a88d"}
Oct 30 21:03:13.569286 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.568056    4948 generic.go:356] "Generic (PLEG): container finished" podID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerID="59094c9183b9652a65943cfbc77087db932aa428dd39f79fdfd3e00fba60a34e" exitCode=0
Oct 30 21:03:13.569286 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.568218    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" event={"ID":"aad11c1f-9bd6-4268-9759-2589245b9a91","Type":"ContainerDied","Data":"59094c9183b9652a65943cfbc77087db932aa428dd39f79fdfd3e00fba60a34e"}
Oct 30 21:03:13.569286 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.568272    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg" event={"ID":"aad11c1f-9bd6-4268-9759-2589245b9a91","Type":"ContainerDied","Data":"7d82901587393f48618b2f68ab9ea2e7e3ffdc19ccb946b5382b5eaf8ac63a93"}
Oct 30 21:03:13.569807 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.569298    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"
Oct 30 21:03:13.569807 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.569547    4948 scope.go:122] "RemoveContainer" containerID="ec49cc49b15415ea95e8977140356df3a7cabb7b12b7d97c17a6c98db43a0e2e"
Oct 30 21:03:13.571834 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:13.570279    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec49cc49b15415ea95e8977140356df3a7cabb7b12b7d97c17a6c98db43a0e2e\": container with ID starting with ec49cc49b15415ea95e8977140356df3a7cabb7b12b7d97c17a6c98db43a0e2e not found: ID does not exist" containerID="ec49cc49b15415ea95e8977140356df3a7cabb7b12b7d97c17a6c98db43a0e2e"
Oct 30 21:03:13.571834 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.570324    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec49cc49b15415ea95e8977140356df3a7cabb7b12b7d97c17a6c98db43a0e2e"} err="failed to get container status \"ec49cc49b15415ea95e8977140356df3a7cabb7b12b7d97c17a6c98db43a0e2e\": rpc error: code = NotFound desc = could not find container \"ec49cc49b15415ea95e8977140356df3a7cabb7b12b7d97c17a6c98db43a0e2e\": container with ID starting with ec49cc49b15415ea95e8977140356df3a7cabb7b12b7d97c17a6c98db43a0e2e not found: ID does not exist"
Oct 30 21:03:13.571834 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.570351    4948 scope.go:122] "RemoveContainer" containerID="0291f38cd5bb8b5194626bedac9b86738af8cb730807416687f5b428d63248e9"
Oct 30 21:03:13.572373 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.572228    4948 generic.go:356] "Generic (PLEG): container finished" podID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerID="f8e91bf581e61ef72c68706200a3ba7b3193943bd926d3a936fdb372a30d997b" exitCode=0
Oct 30 21:03:13.572373 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.572327    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" event={"ID":"459a9978-d5ae-419b-a4c2-ebfa6078326d","Type":"ContainerDied","Data":"f8e91bf581e61ef72c68706200a3ba7b3193943bd926d3a936fdb372a30d997b"}
Oct 30 21:03:13.572596 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.572407    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh" event={"ID":"459a9978-d5ae-419b-a4c2-ebfa6078326d","Type":"ContainerDied","Data":"fe61e2c0310ca576d6328f0d10003b1545321a82b4ba8dd8ae0044681a0214ee"}
Oct 30 21:03:13.572596 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.572509    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"
Oct 30 21:03:13.580080 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.579933    4948 generic.go:356] "Generic (PLEG): container finished" podID="755c4a92-3dbc-4c53-9c9e-3092071391cd" containerID="f307609e370e2f5cda52a890095b23cead1cad1ce04dcf26b1b5150d203e5bc9" exitCode=0
Oct 30 21:03:13.580080 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.580048    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"
Oct 30 21:03:13.580324 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.580048    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4" event={"ID":"755c4a92-3dbc-4c53-9c9e-3092071391cd","Type":"ContainerDied","Data":"f307609e370e2f5cda52a890095b23cead1cad1ce04dcf26b1b5150d203e5bc9"}
Oct 30 21:03:13.580324 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.580236    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4" event={"ID":"755c4a92-3dbc-4c53-9c9e-3092071391cd","Type":"ContainerDied","Data":"930b1e3c7c2fc06bb4b283484f507f29d7fde0420d43ec6686ab144a83cd9813"}
Oct 30 21:03:13.587735 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.587705    4948 scope.go:122] "RemoveContainer" containerID="0291f38cd5bb8b5194626bedac9b86738af8cb730807416687f5b428d63248e9"
Oct 30 21:03:13.588190 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:13.588157    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0291f38cd5bb8b5194626bedac9b86738af8cb730807416687f5b428d63248e9\": container with ID starting with 0291f38cd5bb8b5194626bedac9b86738af8cb730807416687f5b428d63248e9 not found: ID does not exist" containerID="0291f38cd5bb8b5194626bedac9b86738af8cb730807416687f5b428d63248e9"
Oct 30 21:03:13.588276 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.588203    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0291f38cd5bb8b5194626bedac9b86738af8cb730807416687f5b428d63248e9"} err="failed to get container status \"0291f38cd5bb8b5194626bedac9b86738af8cb730807416687f5b428d63248e9\": rpc error: code = NotFound desc = could not find container \"0291f38cd5bb8b5194626bedac9b86738af8cb730807416687f5b428d63248e9\": container with ID starting with 0291f38cd5bb8b5194626bedac9b86738af8cb730807416687f5b428d63248e9 not found: ID does not exist"
Oct 30 21:03:13.588276 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.588230    4948 scope.go:122] "RemoveContainer" containerID="d627d6fa3cd7ceeb9df8d07ed0780750b788a0472db8441612217ab8577ed286"
Oct 30 21:03:13.600216 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.600181    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"]
Oct 30 21:03:13.603655 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.603635    4948 scope.go:122] "RemoveContainer" containerID="d627d6fa3cd7ceeb9df8d07ed0780750b788a0472db8441612217ab8577ed286"
Oct 30 21:03:13.604017 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:13.603994    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d627d6fa3cd7ceeb9df8d07ed0780750b788a0472db8441612217ab8577ed286\": container with ID starting with d627d6fa3cd7ceeb9df8d07ed0780750b788a0472db8441612217ab8577ed286 not found: ID does not exist" containerID="d627d6fa3cd7ceeb9df8d07ed0780750b788a0472db8441612217ab8577ed286"
Oct 30 21:03:13.604078 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.604027    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d627d6fa3cd7ceeb9df8d07ed0780750b788a0472db8441612217ab8577ed286"} err="failed to get container status \"d627d6fa3cd7ceeb9df8d07ed0780750b788a0472db8441612217ab8577ed286\": rpc error: code = NotFound desc = could not find container \"d627d6fa3cd7ceeb9df8d07ed0780750b788a0472db8441612217ab8577ed286\": container with ID starting with d627d6fa3cd7ceeb9df8d07ed0780750b788a0472db8441612217ab8577ed286 not found: ID does not exist"
Oct 30 21:03:13.604078 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.604047    4948 scope.go:122] "RemoveContainer" containerID="954929a629d4f1a2d36bae649812c5ba0b454c46552e898e67aef9223c7e86bc"
Oct 30 21:03:13.615623 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.615597    4948 scope.go:122] "RemoveContainer" containerID="954929a629d4f1a2d36bae649812c5ba0b454c46552e898e67aef9223c7e86bc"
Oct 30 21:03:13.616041 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:13.616019    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"954929a629d4f1a2d36bae649812c5ba0b454c46552e898e67aef9223c7e86bc\": container with ID starting with 954929a629d4f1a2d36bae649812c5ba0b454c46552e898e67aef9223c7e86bc not found: ID does not exist" containerID="954929a629d4f1a2d36bae649812c5ba0b454c46552e898e67aef9223c7e86bc"
Oct 30 21:03:13.616123 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.616056    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"954929a629d4f1a2d36bae649812c5ba0b454c46552e898e67aef9223c7e86bc"} err="failed to get container status \"954929a629d4f1a2d36bae649812c5ba0b454c46552e898e67aef9223c7e86bc\": rpc error: code = NotFound desc = could not find container \"954929a629d4f1a2d36bae649812c5ba0b454c46552e898e67aef9223c7e86bc\": container with ID starting with 954929a629d4f1a2d36bae649812c5ba0b454c46552e898e67aef9223c7e86bc not found: ID does not exist"
Oct 30 21:03:13.616123 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.616083    4948 scope.go:122] "RemoveContainer" containerID="59094c9183b9652a65943cfbc77087db932aa428dd39f79fdfd3e00fba60a34e"
Oct 30 21:03:13.616953 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.616894    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-wbmhw"]
Oct 30 21:03:13.627077 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.627049    4948 scope.go:122] "RemoveContainer" containerID="59094c9183b9652a65943cfbc77087db932aa428dd39f79fdfd3e00fba60a34e"
Oct 30 21:03:13.627473 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:13.627448    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59094c9183b9652a65943cfbc77087db932aa428dd39f79fdfd3e00fba60a34e\": container with ID starting with 59094c9183b9652a65943cfbc77087db932aa428dd39f79fdfd3e00fba60a34e not found: ID does not exist" containerID="59094c9183b9652a65943cfbc77087db932aa428dd39f79fdfd3e00fba60a34e"
Oct 30 21:03:13.627546 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.627485    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59094c9183b9652a65943cfbc77087db932aa428dd39f79fdfd3e00fba60a34e"} err="failed to get container status \"59094c9183b9652a65943cfbc77087db932aa428dd39f79fdfd3e00fba60a34e\": rpc error: code = NotFound desc = could not find container \"59094c9183b9652a65943cfbc77087db932aa428dd39f79fdfd3e00fba60a34e\": container with ID starting with 59094c9183b9652a65943cfbc77087db932aa428dd39f79fdfd3e00fba60a34e not found: ID does not exist"
Oct 30 21:03:13.627672 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.627547    4948 scope.go:122] "RemoveContainer" containerID="f8e91bf581e61ef72c68706200a3ba7b3193943bd926d3a936fdb372a30d997b"
Oct 30 21:03:13.631573 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.631542    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"]
Oct 30 21:03:13.636040 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.636010    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-hvnfz"]
Oct 30 21:03:13.638784 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.638762    4948 scope.go:122] "RemoveContainer" containerID="f8e91bf581e61ef72c68706200a3ba7b3193943bd926d3a936fdb372a30d997b"
Oct 30 21:03:13.639239 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:13.639141    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8e91bf581e61ef72c68706200a3ba7b3193943bd926d3a936fdb372a30d997b\": container with ID starting with f8e91bf581e61ef72c68706200a3ba7b3193943bd926d3a936fdb372a30d997b not found: ID does not exist" containerID="f8e91bf581e61ef72c68706200a3ba7b3193943bd926d3a936fdb372a30d997b"
Oct 30 21:03:13.639239 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.639195    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8e91bf581e61ef72c68706200a3ba7b3193943bd926d3a936fdb372a30d997b"} err="failed to get container status \"f8e91bf581e61ef72c68706200a3ba7b3193943bd926d3a936fdb372a30d997b\": rpc error: code = NotFound desc = could not find container \"f8e91bf581e61ef72c68706200a3ba7b3193943bd926d3a936fdb372a30d997b\": container with ID starting with f8e91bf581e61ef72c68706200a3ba7b3193943bd926d3a936fdb372a30d997b not found: ID does not exist"
Oct 30 21:03:13.639239 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.639222    4948 scope.go:122] "RemoveContainer" containerID="f307609e370e2f5cda52a890095b23cead1cad1ce04dcf26b1b5150d203e5bc9"
Oct 30 21:03:13.650710 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.650684    4948 scope.go:122] "RemoveContainer" containerID="f307609e370e2f5cda52a890095b23cead1cad1ce04dcf26b1b5150d203e5bc9"
Oct 30 21:03:13.652017 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:13.651987    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f307609e370e2f5cda52a890095b23cead1cad1ce04dcf26b1b5150d203e5bc9\": container with ID starting with f307609e370e2f5cda52a890095b23cead1cad1ce04dcf26b1b5150d203e5bc9 not found: ID does not exist" containerID="f307609e370e2f5cda52a890095b23cead1cad1ce04dcf26b1b5150d203e5bc9"
Oct 30 21:03:13.652140 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.652023    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f307609e370e2f5cda52a890095b23cead1cad1ce04dcf26b1b5150d203e5bc9"} err="failed to get container status \"f307609e370e2f5cda52a890095b23cead1cad1ce04dcf26b1b5150d203e5bc9\": rpc error: code = NotFound desc = could not find container \"f307609e370e2f5cda52a890095b23cead1cad1ce04dcf26b1b5150d203e5bc9\": container with ID starting with f307609e370e2f5cda52a890095b23cead1cad1ce04dcf26b1b5150d203e5bc9 not found: ID does not exist"
Oct 30 21:03:13.667601 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.667560    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"]
Oct 30 21:03:13.673558 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.673522    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-8cz8f"]
Oct 30 21:03:13.696180 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.696135    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"]
Oct 30 21:03:13.702508 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.702470    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-khblk"]
Oct 30 21:03:13.715977 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.715936    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"]
Oct 30 21:03:13.726459 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.726427    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-t82xh"]
Oct 30 21:03:13.747852 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.747815    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"]
Oct 30 21:03:13.752955 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.752917    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-k4hzg"]
Oct 30 21:03:13.767023 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.766985    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"]
Oct 30 21:03:13.777943 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:13.777895    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-schn4"]
Oct 30 21:03:14.219836 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:14.219800    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:14.296306 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:14.296265    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" path="/var/lib/kubelet/pods/00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54/volumes"
Oct 30 21:03:14.296812 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:14.296796    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="24dd0839-321b-426a-a667-42b366bba980" path="/var/lib/kubelet/pods/24dd0839-321b-426a-a667-42b366bba980/volumes"
Oct 30 21:03:14.297219 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:14.297206    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" path="/var/lib/kubelet/pods/29bd5543-e7f6-4989-877b-47efbbc7ab19/volumes"
Oct 30 21:03:14.298027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:14.298011    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" path="/var/lib/kubelet/pods/459a9978-d5ae-419b-a4c2-ebfa6078326d/volumes"
Oct 30 21:03:14.298488 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:14.298474    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7123b746-4253-4381-8585-b0090b9fbb22" path="/var/lib/kubelet/pods/7123b746-4253-4381-8585-b0090b9fbb22/volumes"
Oct 30 21:03:14.298887 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:14.298874    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="755c4a92-3dbc-4c53-9c9e-3092071391cd" path="/var/lib/kubelet/pods/755c4a92-3dbc-4c53-9c9e-3092071391cd/volumes"
Oct 30 21:03:14.299615 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:14.299600    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" path="/var/lib/kubelet/pods/aad11c1f-9bd6-4268-9759-2589245b9a91/volumes"
Oct 30 21:03:14.300022 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:14.300008    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ec5914af-5cdd-425a-a0d3-9b6ba2947947" path="/var/lib/kubelet/pods/ec5914af-5cdd-425a-a0d3-9b6ba2947947/volumes"
Oct 30 21:03:14.994526 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:14.994483    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:15.254810 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:15.254715    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"]
Oct 30 21:03:15.255248 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:15.254981    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy" containerID="cri-o://2b84cc431a1f659a6ec8c6e351c5c0f74327e0d0278dc728515ab18b78f59903" gracePeriod=30
Oct 30 21:03:15.259330 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:15.259297    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"]
Oct 30 21:03:15.259649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:15.259620    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z" podUID="a33086b6-3909-4317-ab87-877c36019f4e" containerName="istio-proxy" containerID="cri-o://427912bcf85b0e1b067283eaf0c294a054452943de212249575fbcd608518755" gracePeriod=30
Oct 30 21:03:15.261773 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:15.261748    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"]
Oct 30 21:03:15.262022 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:15.261996    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t" podUID="0141b4ff-f223-4fed-be7e-16f2e33ec90a" containerName="istio-proxy" containerID="cri-o://2d548f4f8e36775ea6db120634ebd0db0b831a7375fe668f016681a15a909f7e" gracePeriod=30
Oct 30 21:03:15.427412 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:15.419763    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:15.695501 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:15.695458    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:16.114513 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:16.114477    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:16.351421 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:16.351351    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:17.311219 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:17.311174    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:17.445134 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:17.445088    4948 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:03:17.445563 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:17.445174    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z" podUID="a33086b6-3909-4317-ab87-877c36019f4e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:03:18.257397 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:18.257330    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:19.319651 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:19.319613    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:20.287550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.287502    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:20.534886 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.534782    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:03:20.562063 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.562012    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-workload-certs\") pod \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") "
Oct 30 21:03:20.562243 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.562091    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-kube-api-access-6c5s7\" (UniqueName: \"kubernetes.io/projected/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-kube-api-access-6c5s7\") pod \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") "
Oct 30 21:03:20.562243 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.562170    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-workload-socket\") pod \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") "
Oct 30 21:03:20.562243 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.562202    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-podinfo\") pod \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") "
Oct 30 21:03:20.562516 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.562251    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istiod-ca-cert\") pod \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") "
Oct 30 21:03:20.562516 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.562300    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-credential-socket\") pod \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") "
Oct 30 21:03:20.562516 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.562349    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-data\") pod \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") "
Oct 30 21:03:20.562516 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.562481    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-token\" (UniqueName: \"kubernetes.io/projected/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-token\") pod \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") "
Oct 30 21:03:20.562735 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.562519    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-envoy\") pod \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\" (UID: \"ce51fe2f-476c-4e0e-8b93-d4d71290ed18\") "
Oct 30 21:03:20.564499 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.563314    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-workload-socket" pod "ce51fe2f-476c-4e0e-8b93-d4d71290ed18" (UID: "ce51fe2f-476c-4e0e-8b93-d4d71290ed18"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.564499 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.563519    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-data" pod "ce51fe2f-476c-4e0e-8b93-d4d71290ed18" (UID: "ce51fe2f-476c-4e0e-8b93-d4d71290ed18"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.564499 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.563762    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istiod-ca-cert" pod "ce51fe2f-476c-4e0e-8b93-d4d71290ed18" (UID: "ce51fe2f-476c-4e0e-8b93-d4d71290ed18"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:20.564499 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.564217    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-credential-socket" pod "ce51fe2f-476c-4e0e-8b93-d4d71290ed18" (UID: "ce51fe2f-476c-4e0e-8b93-d4d71290ed18"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.566741 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.566049    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-podinfo" pod "ce51fe2f-476c-4e0e-8b93-d4d71290ed18" (UID: "ce51fe2f-476c-4e0e-8b93-d4d71290ed18"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:20.566741 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.566697    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-workload-certs" pod "ce51fe2f-476c-4e0e-8b93-d4d71290ed18" (UID: "ce51fe2f-476c-4e0e-8b93-d4d71290ed18"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.568119 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.568053    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-kube-api-access-6c5s7" pod "ce51fe2f-476c-4e0e-8b93-d4d71290ed18" (UID: "ce51fe2f-476c-4e0e-8b93-d4d71290ed18"). InnerVolumeSpecName "kube-api-access-6c5s7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:20.568275 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.568249    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-envoy" pod "ce51fe2f-476c-4e0e-8b93-d4d71290ed18" (UID: "ce51fe2f-476c-4e0e-8b93-d4d71290ed18"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.576059 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.576013    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-token" pod "ce51fe2f-476c-4e0e-8b93-d4d71290ed18" (UID: "ce51fe2f-476c-4e0e-8b93-d4d71290ed18"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:20.583849 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.583813    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:03:20.622810 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.622773    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 21:03:20.633816 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.633776    4948 generic.go:356] "Generic (PLEG): container finished" podID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerID="2b84cc431a1f659a6ec8c6e351c5c0f74327e0d0278dc728515ab18b78f59903" exitCode=0
Oct 30 21:03:20.634022 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.633876    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"
Oct 30 21:03:20.634022 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.633906    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" event={"ID":"ce51fe2f-476c-4e0e-8b93-d4d71290ed18","Type":"ContainerDied","Data":"2b84cc431a1f659a6ec8c6e351c5c0f74327e0d0278dc728515ab18b78f59903"}
Oct 30 21:03:20.634022 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.633966    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf" event={"ID":"ce51fe2f-476c-4e0e-8b93-d4d71290ed18","Type":"ContainerDied","Data":"86ca2d2f177d223d1b4f8e6eb6a27859b99a5bc65eca4cca38fdb0ed943f7d8e"}
Oct 30 21:03:20.634022 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.633996    4948 scope.go:122] "RemoveContainer" containerID="2b84cc431a1f659a6ec8c6e351c5c0f74327e0d0278dc728515ab18b78f59903"
Oct 30 21:03:20.636028 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.635997    4948 generic.go:356] "Generic (PLEG): container finished" podID="a33086b6-3909-4317-ab87-877c36019f4e" containerID="427912bcf85b0e1b067283eaf0c294a054452943de212249575fbcd608518755" exitCode=0
Oct 30 21:03:20.636211 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.636074    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"
Oct 30 21:03:20.636284 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.636082    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z" event={"ID":"a33086b6-3909-4317-ab87-877c36019f4e","Type":"ContainerDied","Data":"427912bcf85b0e1b067283eaf0c294a054452943de212249575fbcd608518755"}
Oct 30 21:03:20.636350 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.636332    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z" event={"ID":"a33086b6-3909-4317-ab87-877c36019f4e","Type":"ContainerDied","Data":"9050fead7ee6ffa6b7c737c78141db2cf8451b1f0d81a86d60e5b76132047012"}
Oct 30 21:03:20.638428 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.638351    4948 generic.go:356] "Generic (PLEG): container finished" podID="0141b4ff-f223-4fed-be7e-16f2e33ec90a" containerID="2d548f4f8e36775ea6db120634ebd0db0b831a7375fe668f016681a15a909f7e" exitCode=0
Oct 30 21:03:20.638547 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.638443    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"
Oct 30 21:03:20.638547 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.638446    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t" event={"ID":"0141b4ff-f223-4fed-be7e-16f2e33ec90a","Type":"ContainerDied","Data":"2d548f4f8e36775ea6db120634ebd0db0b831a7375fe668f016681a15a909f7e"}
Oct 30 21:03:20.638547 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.638505    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t" event={"ID":"0141b4ff-f223-4fed-be7e-16f2e33ec90a","Type":"ContainerDied","Data":"91768b17653c386652247fbe7e1079c3ec51e5324bbb17fd741bc3cb09ffb6c0"}
Oct 30 21:03:20.646335 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.646308    4948 scope.go:122] "RemoveContainer" containerID="2b84cc431a1f659a6ec8c6e351c5c0f74327e0d0278dc728515ab18b78f59903"
Oct 30 21:03:20.646728 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:20.646709    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b84cc431a1f659a6ec8c6e351c5c0f74327e0d0278dc728515ab18b78f59903\": container with ID starting with 2b84cc431a1f659a6ec8c6e351c5c0f74327e0d0278dc728515ab18b78f59903 not found: ID does not exist" containerID="2b84cc431a1f659a6ec8c6e351c5c0f74327e0d0278dc728515ab18b78f59903"
Oct 30 21:03:20.646794 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.646743    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b84cc431a1f659a6ec8c6e351c5c0f74327e0d0278dc728515ab18b78f59903"} err="failed to get container status \"2b84cc431a1f659a6ec8c6e351c5c0f74327e0d0278dc728515ab18b78f59903\": rpc error: code = NotFound desc = could not find container \"2b84cc431a1f659a6ec8c6e351c5c0f74327e0d0278dc728515ab18b78f59903\": container with ID starting with 2b84cc431a1f659a6ec8c6e351c5c0f74327e0d0278dc728515ab18b78f59903 not found: ID does not exist"
Oct 30 21:03:20.646794 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.646762    4948 scope.go:122] "RemoveContainer" containerID="427912bcf85b0e1b067283eaf0c294a054452943de212249575fbcd608518755"
Oct 30 21:03:20.656422 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.656399    4948 scope.go:122] "RemoveContainer" containerID="1cd116f9569a4274caa8f8a583d67eed840de85f831dd84bd3dfb5f16cefa2d0"
Oct 30 21:03:20.663999 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.663958    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-workload-certs\") pod \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") "
Oct 30 21:03:20.664161 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664018    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-workload-socket\") pod \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") "
Oct 30 21:03:20.664161 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664068    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-istio-envoy\") pod \"a33086b6-3909-4317-ab87-877c36019f4e\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") "
Oct 30 21:03:20.664161 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664107    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-token\" (UniqueName: \"kubernetes.io/projected/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-token\") pod \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") "
Oct 30 21:03:20.664161 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664146    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-istio-data\") pod \"a33086b6-3909-4317-ab87-877c36019f4e\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") "
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664222    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a33086b6-3909-4317-ab87-877c36019f4e-kube-api-access-gx7g2\" (UniqueName: \"kubernetes.io/projected/a33086b6-3909-4317-ab87-877c36019f4e-kube-api-access-gx7g2\") pod \"a33086b6-3909-4317-ab87-877c36019f4e\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") "
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664251    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-workload-certs" pod "0141b4ff-f223-4fed-be7e-16f2e33ec90a" (UID: "0141b4ff-f223-4fed-be7e-16f2e33ec90a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664295    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-workload-certs\") pod \"a33086b6-3909-4317-ab87-877c36019f4e\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") "
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664328    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-podinfo\") pod \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") "
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664355    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-workload-socket" pod "0141b4ff-f223-4fed-be7e-16f2e33ec90a" (UID: "0141b4ff-f223-4fed-be7e-16f2e33ec90a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664421    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istiod-ca-cert\") pod \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") "
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664457    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-envoy\") pod \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") "
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664495    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a33086b6-3909-4317-ab87-877c36019f4e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a33086b6-3909-4317-ab87-877c36019f4e-istiod-ca-cert\") pod \"a33086b6-3909-4317-ab87-877c36019f4e\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") "
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664524    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-data\") pod \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") "
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664557    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a33086b6-3909-4317-ab87-877c36019f4e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a33086b6-3909-4317-ab87-877c36019f4e-istio-podinfo\") pod \"a33086b6-3909-4317-ab87-877c36019f4e\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") "
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664606    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-workload-socket\") pod \"a33086b6-3909-4317-ab87-877c36019f4e\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") "
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664653    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a33086b6-3909-4317-ab87-877c36019f4e-istio-token\" (UniqueName: \"kubernetes.io/projected/a33086b6-3909-4317-ab87-877c36019f4e-istio-token\") pod \"a33086b6-3909-4317-ab87-877c36019f4e\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") "
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664682    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-credential-socket\") pod \"a33086b6-3909-4317-ab87-877c36019f4e\" (UID: \"a33086b6-3909-4317-ab87-877c36019f4e\") "
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664725    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0141b4ff-f223-4fed-be7e-16f2e33ec90a-kube-api-access-rvv67\" (UniqueName: \"kubernetes.io/projected/0141b4ff-f223-4fed-be7e-16f2e33ec90a-kube-api-access-rvv67\") pod \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") "
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664724    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-workload-certs" pod "a33086b6-3909-4317-ab87-877c36019f4e" (UID: "a33086b6-3909-4317-ab87-877c36019f4e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664780    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-credential-socket\") pod \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\" (UID: \"0141b4ff-f223-4fed-be7e-16f2e33ec90a\") "
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664813    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istiod-ca-cert" pod "0141b4ff-f223-4fed-be7e-16f2e33ec90a" (UID: "0141b4ff-f223-4fed-be7e-16f2e33ec90a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664904    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-data" pod "0141b4ff-f223-4fed-be7e-16f2e33ec90a" (UID: "0141b4ff-f223-4fed-be7e-16f2e33ec90a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.664960    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-workload-socket" pod "a33086b6-3909-4317-ab87-877c36019f4e" (UID: "a33086b6-3909-4317-ab87-877c36019f4e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665066    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-istio-data" pod "a33086b6-3909-4317-ab87-877c36019f4e" (UID: "a33086b6-3909-4317-ab87-877c36019f4e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665082    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-credential-socket" pod "a33086b6-3909-4317-ab87-877c36019f4e" (UID: "a33086b6-3909-4317-ab87-877c36019f4e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665246    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-credential-socket" pod "0141b4ff-f223-4fed-be7e-16f2e33ec90a" (UID: "0141b4ff-f223-4fed-be7e-16f2e33ec90a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.665463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665423    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a33086b6-3909-4317-ab87-877c36019f4e-istiod-ca-cert" pod "a33086b6-3909-4317-ab87-877c36019f4e" (UID: "a33086b6-3909-4317-ab87-877c36019f4e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665747    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665774    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665792    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665808    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665823    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665838    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665853    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665867    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665881    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665896    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665912    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665927    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a33086b6-3909-4317-ab87-877c36019f4e-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665943    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665957    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665972    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.665988    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.666004    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6c5s7\" (UniqueName: \"kubernetes.io/projected/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-kube-api-access-6c5s7\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.666021    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.666965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.666036    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce51fe2f-476c-4e0e-8b93-d4d71290ed18-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.668084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.667113    4948 scope.go:122] "RemoveContainer" containerID="427912bcf85b0e1b067283eaf0c294a054452943de212249575fbcd608518755"
Oct 30 21:03:20.668084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.667505    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-podinfo" pod "0141b4ff-f223-4fed-be7e-16f2e33ec90a" (UID: "0141b4ff-f223-4fed-be7e-16f2e33ec90a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:20.668084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.667684    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-token" pod "0141b4ff-f223-4fed-be7e-16f2e33ec90a" (UID: "0141b4ff-f223-4fed-be7e-16f2e33ec90a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:20.668084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.667715    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a33086b6-3909-4317-ab87-877c36019f4e-kube-api-access-gx7g2" pod "a33086b6-3909-4317-ab87-877c36019f4e" (UID: "a33086b6-3909-4317-ab87-877c36019f4e"). InnerVolumeSpecName "kube-api-access-gx7g2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:20.668084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.667803    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-istio-envoy" pod "a33086b6-3909-4317-ab87-877c36019f4e" (UID: "a33086b6-3909-4317-ab87-877c36019f4e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.668084 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:20.667845    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"427912bcf85b0e1b067283eaf0c294a054452943de212249575fbcd608518755\": container with ID starting with 427912bcf85b0e1b067283eaf0c294a054452943de212249575fbcd608518755 not found: ID does not exist" containerID="427912bcf85b0e1b067283eaf0c294a054452943de212249575fbcd608518755"
Oct 30 21:03:20.668084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.667881    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427912bcf85b0e1b067283eaf0c294a054452943de212249575fbcd608518755"} err="failed to get container status \"427912bcf85b0e1b067283eaf0c294a054452943de212249575fbcd608518755\": rpc error: code = NotFound desc = could not find container \"427912bcf85b0e1b067283eaf0c294a054452943de212249575fbcd608518755\": container with ID starting with 427912bcf85b0e1b067283eaf0c294a054452943de212249575fbcd608518755 not found: ID does not exist"
Oct 30 21:03:20.668084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.667901    4948 scope.go:122] "RemoveContainer" containerID="1cd116f9569a4274caa8f8a583d67eed840de85f831dd84bd3dfb5f16cefa2d0"
Oct 30 21:03:20.668665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.668124    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0141b4ff-f223-4fed-be7e-16f2e33ec90a-kube-api-access-rvv67" pod "0141b4ff-f223-4fed-be7e-16f2e33ec90a" (UID: "0141b4ff-f223-4fed-be7e-16f2e33ec90a"). InnerVolumeSpecName "kube-api-access-rvv67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:20.668665 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:20.668224    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cd116f9569a4274caa8f8a583d67eed840de85f831dd84bd3dfb5f16cefa2d0\": container with ID starting with 1cd116f9569a4274caa8f8a583d67eed840de85f831dd84bd3dfb5f16cefa2d0 not found: ID does not exist" containerID="1cd116f9569a4274caa8f8a583d67eed840de85f831dd84bd3dfb5f16cefa2d0"
Oct 30 21:03:20.668665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.668255    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cd116f9569a4274caa8f8a583d67eed840de85f831dd84bd3dfb5f16cefa2d0"} err="failed to get container status \"1cd116f9569a4274caa8f8a583d67eed840de85f831dd84bd3dfb5f16cefa2d0\": rpc error: code = NotFound desc = could not find container \"1cd116f9569a4274caa8f8a583d67eed840de85f831dd84bd3dfb5f16cefa2d0\": container with ID starting with 1cd116f9569a4274caa8f8a583d67eed840de85f831dd84bd3dfb5f16cefa2d0 not found: ID does not exist"
Oct 30 21:03:20.668665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.668277    4948 scope.go:122] "RemoveContainer" containerID="2d548f4f8e36775ea6db120634ebd0db0b831a7375fe668f016681a15a909f7e"
Oct 30 21:03:20.668665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.668320    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a33086b6-3909-4317-ab87-877c36019f4e-istio-token" pod "a33086b6-3909-4317-ab87-877c36019f4e" (UID: "a33086b6-3909-4317-ab87-877c36019f4e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:20.669088 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.669059    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-envoy" pod "0141b4ff-f223-4fed-be7e-16f2e33ec90a" (UID: "0141b4ff-f223-4fed-be7e-16f2e33ec90a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.669449 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.669341    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a33086b6-3909-4317-ab87-877c36019f4e-istio-podinfo" pod "a33086b6-3909-4317-ab87-877c36019f4e" (UID: "a33086b6-3909-4317-ab87-877c36019f4e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:20.681482 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.680708    4948 scope.go:122] "RemoveContainer" containerID="2d548f4f8e36775ea6db120634ebd0db0b831a7375fe668f016681a15a909f7e"
Oct 30 21:03:20.681482 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:20.681257    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d548f4f8e36775ea6db120634ebd0db0b831a7375fe668f016681a15a909f7e\": container with ID starting with 2d548f4f8e36775ea6db120634ebd0db0b831a7375fe668f016681a15a909f7e not found: ID does not exist" containerID="2d548f4f8e36775ea6db120634ebd0db0b831a7375fe668f016681a15a909f7e"
Oct 30 21:03:20.681482 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.681298    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d548f4f8e36775ea6db120634ebd0db0b831a7375fe668f016681a15a909f7e"} err="failed to get container status \"2d548f4f8e36775ea6db120634ebd0db0b831a7375fe668f016681a15a909f7e\": rpc error: code = NotFound desc = could not find container \"2d548f4f8e36775ea6db120634ebd0db0b831a7375fe668f016681a15a909f7e\": container with ID starting with 2d548f4f8e36775ea6db120634ebd0db0b831a7375fe668f016681a15a909f7e not found: ID does not exist"
Oct 30 21:03:20.708243 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.708192    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"]
Oct 30 21:03:20.716606 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.716324    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gjpmf"]
Oct 30 21:03:20.767702 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.767661    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx7g2\" (UniqueName: \"kubernetes.io/projected/a33086b6-3909-4317-ab87-877c36019f4e-kube-api-access-gx7g2\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.767702 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.767694    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.767702 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.767707    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.767968 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.767716    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a33086b6-3909-4317-ab87-877c36019f4e-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.767968 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.767727    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a33086b6-3909-4317-ab87-877c36019f4e-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.767968 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.767738    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvv67\" (UniqueName: \"kubernetes.io/projected/0141b4ff-f223-4fed-be7e-16f2e33ec90a-kube-api-access-rvv67\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.767968 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.767751    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a33086b6-3909-4317-ab87-877c36019f4e-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.767968 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.767760    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0141b4ff-f223-4fed-be7e-16f2e33ec90a-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.823804 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.823699    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:20.970140 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.970102    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"]
Oct 30 21:03:20.975901 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.975861    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-qnp2t"]
Oct 30 21:03:20.993134 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.993086    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"]
Oct 30 21:03:20.995441 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:20.995412    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-hvn2z"]
Oct 30 21:03:21.353580 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:21.353516    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:22.248768 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:22.248727    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:22.295109 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:22.295069    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0141b4ff-f223-4fed-be7e-16f2e33ec90a" path="/var/lib/kubelet/pods/0141b4ff-f223-4fed-be7e-16f2e33ec90a/volumes"
Oct 30 21:03:22.295556 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:22.295538    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a33086b6-3909-4317-ab87-877c36019f4e" path="/var/lib/kubelet/pods/a33086b6-3909-4317-ab87-877c36019f4e/volumes"
Oct 30 21:03:22.295967 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:22.295953    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" path="/var/lib/kubelet/pods/ce51fe2f-476c-4e0e-8b93-d4d71290ed18/volumes"
Oct 30 21:03:23.222499 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:23.222459    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:23.930834 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:23.930795    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:03:24.439565 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:24.439526    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:24.683577 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:24.683541    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:25.595009 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:25.594972    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:26.418145 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:26.418107    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:27.430794 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:27.430749    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:28.241501 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:28.241465    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:29.036706 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:29.036666    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:29.436121 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:29.436068    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"]
Oct 30 21:03:29.643842 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:29.643781    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:29.966549 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:29.966506    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:30.750180 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:30.750127    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:31.456796 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:31.456754    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:31.673528 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:31.673463    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:32.293218 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:32.293174    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:33.099819 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:33.099775    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:33.897716 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:33.897620    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:34.649015 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:34.648981    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:35.024833 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:35.024730    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:44.320707 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.320668    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:44.457273 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.457204    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main" containerID="cri-o://02645a344e3744aa0a6b3c41ea8200813c18259abe8c12375f109fe0c8017667" gracePeriod=45
Oct 30 21:03:44.729524 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.729485    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 21:03:44.782807 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.782763    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-home\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-home\") pod \"e7cf7f07-fe2a-4871-a47c-da02e96356df\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") "
Oct 30 21:03:44.783043 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.782847    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-model-cache\") pod \"e7cf7f07-fe2a-4871-a47c-da02e96356df\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") "
Oct 30 21:03:44.783043 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.782917    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e7cf7f07-fe2a-4871-a47c-da02e96356df-kube-api-access-5d67h\" (UniqueName: \"kubernetes.io/projected/e7cf7f07-fe2a-4871-a47c-da02e96356df-kube-api-access-5d67h\") pod \"e7cf7f07-fe2a-4871-a47c-da02e96356df\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") "
Oct 30 21:03:44.783043 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.782958    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-tmp-dir\") pod \"e7cf7f07-fe2a-4871-a47c-da02e96356df\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") "
Oct 30 21:03:44.783239 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.783093    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e7cf7f07-fe2a-4871-a47c-da02e96356df-tls-certs\" (UniqueName: \"kubernetes.io/secret/e7cf7f07-fe2a-4871-a47c-da02e96356df-tls-certs\") pod \"e7cf7f07-fe2a-4871-a47c-da02e96356df\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") "
Oct 30 21:03:44.783239 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.783133    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-dshm\") pod \"e7cf7f07-fe2a-4871-a47c-da02e96356df\" (UID: \"e7cf7f07-fe2a-4871-a47c-da02e96356df\") "
Oct 30 21:03:44.783239 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.783142    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-home" pod "e7cf7f07-fe2a-4871-a47c-da02e96356df" (UID: "e7cf7f07-fe2a-4871-a47c-da02e96356df"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:44.783548 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.783525    4948 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-home\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:44.783724 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.783692    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-tmp-dir" pod "e7cf7f07-fe2a-4871-a47c-da02e96356df" (UID: "e7cf7f07-fe2a-4871-a47c-da02e96356df"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:44.784411 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.784344    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-model-cache" pod "e7cf7f07-fe2a-4871-a47c-da02e96356df" (UID: "e7cf7f07-fe2a-4871-a47c-da02e96356df"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:44.786325 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.786284    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7cf7f07-fe2a-4871-a47c-da02e96356df-kube-api-access-5d67h" pod "e7cf7f07-fe2a-4871-a47c-da02e96356df" (UID: "e7cf7f07-fe2a-4871-a47c-da02e96356df"). InnerVolumeSpecName "kube-api-access-5d67h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:44.786490 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.786313    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7cf7f07-fe2a-4871-a47c-da02e96356df-tls-certs" pod "e7cf7f07-fe2a-4871-a47c-da02e96356df" (UID: "e7cf7f07-fe2a-4871-a47c-da02e96356df"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:44.787874 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.787839    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-dshm" pod "e7cf7f07-fe2a-4871-a47c-da02e96356df" (UID: "e7cf7f07-fe2a-4871-a47c-da02e96356df"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:44.813040 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.813001    4948 generic.go:356] "Generic (PLEG): container finished" podID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerID="02645a344e3744aa0a6b3c41ea8200813c18259abe8c12375f109fe0c8017667" exitCode=0
Oct 30 21:03:44.813241 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.813067    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"
Oct 30 21:03:44.813241 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.813078    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" event={"ID":"e7cf7f07-fe2a-4871-a47c-da02e96356df","Type":"ContainerDied","Data":"02645a344e3744aa0a6b3c41ea8200813c18259abe8c12375f109fe0c8017667"}
Oct 30 21:03:44.813241 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.813129    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf" event={"ID":"e7cf7f07-fe2a-4871-a47c-da02e96356df","Type":"ContainerDied","Data":"dba3157137477d7c7ea8e57462bcbd36ec27b8270a05a3517f88b9c6cbd5caac"}
Oct 30 21:03:44.813241 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.813147    4948 scope.go:122] "RemoveContainer" containerID="02645a344e3744aa0a6b3c41ea8200813c18259abe8c12375f109fe0c8017667"
Oct 30 21:03:44.824523 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.824494    4948 scope.go:122] "RemoveContainer" containerID="02645a344e3744aa0a6b3c41ea8200813c18259abe8c12375f109fe0c8017667"
Oct 30 21:03:44.824892 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:44.824872    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02645a344e3744aa0a6b3c41ea8200813c18259abe8c12375f109fe0c8017667\": container with ID starting with 02645a344e3744aa0a6b3c41ea8200813c18259abe8c12375f109fe0c8017667 not found: ID does not exist" containerID="02645a344e3744aa0a6b3c41ea8200813c18259abe8c12375f109fe0c8017667"
Oct 30 21:03:44.824948 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.824903    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02645a344e3744aa0a6b3c41ea8200813c18259abe8c12375f109fe0c8017667"} err="failed to get container status \"02645a344e3744aa0a6b3c41ea8200813c18259abe8c12375f109fe0c8017667\": rpc error: code = NotFound desc = could not find container \"02645a344e3744aa0a6b3c41ea8200813c18259abe8c12375f109fe0c8017667\": container with ID starting with 02645a344e3744aa0a6b3c41ea8200813c18259abe8c12375f109fe0c8017667 not found: ID does not exist"
Oct 30 21:03:44.837984 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.837941    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"]
Oct 30 21:03:44.844441 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.844403    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-c4b379/simulator-w1-c4b379-kserve-7854875dd4-w8czf"]
Oct 30 21:03:44.884677 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.884579    4948 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-model-cache\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:44.884677 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.884614    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5d67h\" (UniqueName: \"kubernetes.io/projected/e7cf7f07-fe2a-4871-a47c-da02e96356df-kube-api-access-5d67h\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:44.884677 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.884628    4948 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-tmp-dir\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:44.884677 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.884637    4948 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7cf7f07-fe2a-4871-a47c-da02e96356df-tls-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:44.884677 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:44.884645    4948 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7cf7f07-fe2a-4871-a47c-da02e96356df-dshm\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:46.294284 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:46.294244    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" path="/var/lib/kubelet/pods/e7cf7f07-fe2a-4871-a47c-da02e96356df/volumes"
Oct 30 21:03:50.505845 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:50.505798    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"]
Oct 30 21:03:50.668341 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:50.668300    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:50.871896 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:50.871853    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:50.874844 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:50.873500    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd" podUID="ed0564b2-afd2-4b28-8a99-a0ae8f46b516" containerName="maas-api" containerID="cri-o://092e0f5f4377222201d73cd6bebd91215e68761957e92e8d306c771e7e5fb07e" gracePeriod=30
Oct 30 21:03:51.155277 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.155245    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 21:03:51.293475 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.293434    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-openshift-service-ca\") pod \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\" (UID: \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\") "
Oct 30 21:03:51.293706 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.293495    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-kube-api-access-6k2zf\" (UniqueName: \"kubernetes.io/projected/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-kube-api-access-6k2zf\") pod \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\" (UID: \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\") "
Oct 30 21:03:51.293706 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.293621    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-metrics-certs\") pod \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\" (UID: \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\") "
Oct 30 21:03:51.293841 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.293706    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-maas-api-tls\") pod \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\" (UID: \"ed0564b2-afd2-4b28-8a99-a0ae8f46b516\") "
Oct 30 21:03:51.293932 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.293905    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-openshift-service-ca" pod "ed0564b2-afd2-4b28-8a99-a0ae8f46b516" (UID: "ed0564b2-afd2-4b28-8a99-a0ae8f46b516"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:51.294211 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.294190    4948 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-openshift-service-ca\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:51.296211 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.296181    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-kube-api-access-6k2zf" pod "ed0564b2-afd2-4b28-8a99-a0ae8f46b516" (UID: "ed0564b2-afd2-4b28-8a99-a0ae8f46b516"). InnerVolumeSpecName "kube-api-access-6k2zf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:51.296321 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.296301    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-metrics-certs" pod "ed0564b2-afd2-4b28-8a99-a0ae8f46b516" (UID: "ed0564b2-afd2-4b28-8a99-a0ae8f46b516"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:51.296400 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.296342    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-maas-api-tls" pod "ed0564b2-afd2-4b28-8a99-a0ae8f46b516" (UID: "ed0564b2-afd2-4b28-8a99-a0ae8f46b516"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:51.383446 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.381508    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:51.396437 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.396393    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k2zf\" (UniqueName: \"kubernetes.io/projected/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-kube-api-access-6k2zf\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:51.396437 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.396435    4948 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-metrics-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:51.396727 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.396453    4948 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed0564b2-afd2-4b28-8a99-a0ae8f46b516-maas-api-tls\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:51.924389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.923957    4948 generic.go:356] "Generic (PLEG): container finished" podID="ed0564b2-afd2-4b28-8a99-a0ae8f46b516" containerID="092e0f5f4377222201d73cd6bebd91215e68761957e92e8d306c771e7e5fb07e" exitCode=0
Oct 30 21:03:51.924389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.924192    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd" event={"ID":"ed0564b2-afd2-4b28-8a99-a0ae8f46b516","Type":"ContainerDied","Data":"092e0f5f4377222201d73cd6bebd91215e68761957e92e8d306c771e7e5fb07e"}
Oct 30 21:03:51.924389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.924292    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd" event={"ID":"ed0564b2-afd2-4b28-8a99-a0ae8f46b516","Type":"ContainerDied","Data":"811be35a67adc11d4d7997b647259f3709074427c472a2c03f6948c2eb8d21d0"}
Oct 30 21:03:51.924389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.924326    4948 scope.go:122] "RemoveContainer" containerID="092e0f5f4377222201d73cd6bebd91215e68761957e92e8d306c771e7e5fb07e"
Oct 30 21:03:51.925137 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:51.924494    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"
Oct 30 21:03:52.043392 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:52.036075    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"]
Oct 30 21:03:52.044307 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:52.044278    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-c4b379-5c9cd789cb-g6hbd"]
Oct 30 21:03:52.044863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:52.044837    4948 scope.go:122] "RemoveContainer" containerID="092e0f5f4377222201d73cd6bebd91215e68761957e92e8d306c771e7e5fb07e"
Oct 30 21:03:52.045533 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:52.045507    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"092e0f5f4377222201d73cd6bebd91215e68761957e92e8d306c771e7e5fb07e\": container with ID starting with 092e0f5f4377222201d73cd6bebd91215e68761957e92e8d306c771e7e5fb07e not found: ID does not exist" containerID="092e0f5f4377222201d73cd6bebd91215e68761957e92e8d306c771e7e5fb07e"
Oct 30 21:03:52.045696 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:52.045667    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"092e0f5f4377222201d73cd6bebd91215e68761957e92e8d306c771e7e5fb07e"} err="failed to get container status \"092e0f5f4377222201d73cd6bebd91215e68761957e92e8d306c771e7e5fb07e\": rpc error: code = NotFound desc = could not find container \"092e0f5f4377222201d73cd6bebd91215e68761957e92e8d306c771e7e5fb07e\": container with ID starting with 092e0f5f4377222201d73cd6bebd91215e68761957e92e8d306c771e7e5fb07e not found: ID does not exist"
Oct 30 21:03:52.341448 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:52.328662    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ed0564b2-afd2-4b28-8a99-a0ae8f46b516" path="/var/lib/kubelet/pods/ed0564b2-afd2-4b28-8a99-a0ae8f46b516/volumes"
Oct 30 21:03:52.516092 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:52.516055    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 21:03:52.516423 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:52.516399    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 21:03:53.929642 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:03:53.929597    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:03:57.410118 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:57.410080    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:57.632288 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:57.632237    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"]
Oct 30 21:03:57.632554 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:57.632529    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw" podUID="64439bcb-741d-4b5c-83c6-f04b69619331" containerName="istio-proxy" containerID="cri-o://4746de5d76e4774f6cbbbfdf3ed9fd641c11c2528f26dbae1304086efa1b91f6" gracePeriod=30
Oct 30 21:03:57.633957 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:57.633927    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:03:57.642223 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:57.635218    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"]
Oct 30 21:03:57.642223 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:57.635595    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz" podUID="cc641a0d-47aa-4281-a0f0-4caa99ac46ce" containerName="istio-proxy" containerID="cri-o://6e43bd17836d9734c313ceb9840a4f539a08dc38256ef5d53d779ee3b0f99f31" gracePeriod=30
Oct 30 21:03:57.644150 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:57.644101    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"]
Oct 30 21:03:57.644528 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:57.644350    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf" podUID="37aaeb67-eddf-4e41-8980-e44ed94a18eb" containerName="istio-proxy" containerID="cri-o://96c33a030c48a240c777eeee691ecc29d14aedf0d5a8a6d250c9420dcb92c64e" gracePeriod=30
Oct 30 21:03:57.659860 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:57.659817    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"]
Oct 30 21:03:57.660084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:57.660057    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy" containerID="cri-o://363c6d72bcad40b63a944dbab89c55d9ba8b93e6a2c68fd103d756ac0f5d9923" gracePeriod=30
Oct 30 21:03:57.841262 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:03:57.841204    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:04:00.347046 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.346998    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55d44b6fdc-t2f9k"]
Oct 30 21:04:00.348165 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.347317    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-55d44b6fdc-t2f9k" podUID="6473d8f0-9a33-42a1-9353-ab78fd79ba6a" containerName="manager" containerID="cri-o://4b1bd4ecd14b0eba39b559a7aa1608eaad666795e1eb9280dac6b4eb0a99a18d" gracePeriod=30
Oct 30 21:04:00.655382 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.655317    4948 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:04:00.655590 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.655432    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:04:00.724343 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.724308    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d44b6fdc-t2f9k"
Oct 30 21:04:00.741240 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.741203    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-kube-api-access-j5dfn\" (UniqueName: \"kubernetes.io/projected/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-kube-api-access-j5dfn\") pod \"6473d8f0-9a33-42a1-9353-ab78fd79ba6a\" (UID: \"6473d8f0-9a33-42a1-9353-ab78fd79ba6a\") "
Oct 30 21:04:00.741528 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.741280    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-webhook-cert\" (UniqueName: \"kubernetes.io/secret/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-webhook-cert\") pod \"6473d8f0-9a33-42a1-9353-ab78fd79ba6a\" (UID: \"6473d8f0-9a33-42a1-9353-ab78fd79ba6a\") "
Oct 30 21:04:00.741528 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.741413    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-metrics-certs\") pod \"6473d8f0-9a33-42a1-9353-ab78fd79ba6a\" (UID: \"6473d8f0-9a33-42a1-9353-ab78fd79ba6a\") "
Oct 30 21:04:00.743605 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.743560    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-kube-api-access-j5dfn" pod "6473d8f0-9a33-42a1-9353-ab78fd79ba6a" (UID: "6473d8f0-9a33-42a1-9353-ab78fd79ba6a"). InnerVolumeSpecName "kube-api-access-j5dfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:00.743605 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.743575    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-metrics-certs" pod "6473d8f0-9a33-42a1-9353-ab78fd79ba6a" (UID: "6473d8f0-9a33-42a1-9353-ab78fd79ba6a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:04:00.743785 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.743656    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-webhook-cert" pod "6473d8f0-9a33-42a1-9353-ab78fd79ba6a" (UID: "6473d8f0-9a33-42a1-9353-ab78fd79ba6a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:04:00.842262 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.842217    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5dfn\" (UniqueName: \"kubernetes.io/projected/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-kube-api-access-j5dfn\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:00.842262 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.842256    4948 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-webhook-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:00.842262 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.842267    4948 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6473d8f0-9a33-42a1-9353-ab78fd79ba6a-metrics-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:00.982279 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.982176    4948 generic.go:356] "Generic (PLEG): container finished" podID="6473d8f0-9a33-42a1-9353-ab78fd79ba6a" containerID="4b1bd4ecd14b0eba39b559a7aa1608eaad666795e1eb9280dac6b4eb0a99a18d" exitCode=0
Oct 30 21:04:00.982279 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.982244    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d44b6fdc-t2f9k"
Oct 30 21:04:00.982279 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.982258    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d44b6fdc-t2f9k" event={"ID":"6473d8f0-9a33-42a1-9353-ab78fd79ba6a","Type":"ContainerDied","Data":"4b1bd4ecd14b0eba39b559a7aa1608eaad666795e1eb9280dac6b4eb0a99a18d"}
Oct 30 21:04:00.982603 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.982314    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d44b6fdc-t2f9k" event={"ID":"6473d8f0-9a33-42a1-9353-ab78fd79ba6a","Type":"ContainerDied","Data":"4e9dc100b198e943824683d1dd0df3267697c55be4b6bbe1f26ed3b7b0d1ac3b"}
Oct 30 21:04:00.982603 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.982338    4948 scope.go:122] "RemoveContainer" containerID="4b1bd4ecd14b0eba39b559a7aa1608eaad666795e1eb9280dac6b4eb0a99a18d"
Oct 30 21:04:00.993782 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.993761    4948 scope.go:122] "RemoveContainer" containerID="4b1bd4ecd14b0eba39b559a7aa1608eaad666795e1eb9280dac6b4eb0a99a18d"
Oct 30 21:04:00.994113 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:04:00.994088    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b1bd4ecd14b0eba39b559a7aa1608eaad666795e1eb9280dac6b4eb0a99a18d\": container with ID starting with 4b1bd4ecd14b0eba39b559a7aa1608eaad666795e1eb9280dac6b4eb0a99a18d not found: ID does not exist" containerID="4b1bd4ecd14b0eba39b559a7aa1608eaad666795e1eb9280dac6b4eb0a99a18d"
Oct 30 21:04:00.994177 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:00.994125    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b1bd4ecd14b0eba39b559a7aa1608eaad666795e1eb9280dac6b4eb0a99a18d"} err="failed to get container status \"4b1bd4ecd14b0eba39b559a7aa1608eaad666795e1eb9280dac6b4eb0a99a18d\": rpc error: code = NotFound desc = could not find container \"4b1bd4ecd14b0eba39b559a7aa1608eaad666795e1eb9280dac6b4eb0a99a18d\": container with ID starting with 4b1bd4ecd14b0eba39b559a7aa1608eaad666795e1eb9280dac6b4eb0a99a18d not found: ID does not exist"
Oct 30 21:04:01.007053 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.007015    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55d44b6fdc-t2f9k"]
Oct 30 21:04:01.011202 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.011166    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55d44b6fdc-t2f9k"]
Oct 30 21:04:01.833466 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.833419    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55d44b6fdc-l4hl9"]
Oct 30 21:04:01.834161 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834137    4948 cpu_manager.go:414] "containerMap: removing container" podUID="f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32" containerName="maas-api"
Oct 30 21:04:01.834210 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834168    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32" containerName="maas-api"
Oct 30 21:04:01.834210 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834185    4948 cpu_manager.go:414] "containerMap: removing container" podUID="8c9c8245-6152-4562-88da-2264625bc3da" containerName="istio-proxy"
Oct 30 21:04:01.834210 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834193    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c9c8245-6152-4562-88da-2264625bc3da" containerName="istio-proxy"
Oct 30 21:04:01.834310 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834211    4948 cpu_manager.go:414] "containerMap: removing container" podUID="21834f97-ced2-4e07-9b75-674e07e584a5" containerName="revoke-keys"
Oct 30 21:04:01.834310 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834220    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="21834f97-ced2-4e07-9b75-674e07e584a5" containerName="revoke-keys"
Oct 30 21:04:01.834310 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834233    4948 cpu_manager.go:414] "containerMap: removing container" podUID="f77b2b95-869a-4e6b-96e1-ce1382ec7896" containerName="istio-proxy"
Oct 30 21:04:01.834310 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834240    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f77b2b95-869a-4e6b-96e1-ce1382ec7896" containerName="istio-proxy"
Oct 30 21:04:01.834310 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834253    4948 cpu_manager.go:414] "containerMap: removing container" podUID="a33086b6-3909-4317-ab87-877c36019f4e" containerName="istio-proxy"
Oct 30 21:04:01.834310 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834259    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a33086b6-3909-4317-ab87-877c36019f4e" containerName="istio-proxy"
Oct 30 21:04:01.834310 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834269    4948 cpu_manager.go:414] "containerMap: removing container" podUID="24dd0839-321b-426a-a667-42b366bba980" containerName="istio-proxy"
Oct 30 21:04:01.834310 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834276    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="24dd0839-321b-426a-a667-42b366bba980" containerName="istio-proxy"
Oct 30 21:04:01.834310 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834286    4948 cpu_manager.go:414] "containerMap: removing container" podUID="755c4a92-3dbc-4c53-9c9e-3092071391cd" containerName="istio-proxy"
Oct 30 21:04:01.834310 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834293    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="755c4a92-3dbc-4c53-9c9e-3092071391cd" containerName="istio-proxy"
Oct 30 21:04:01.834310 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834305    4948 cpu_manager.go:414] "containerMap: removing container" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy"
Oct 30 21:04:01.834310 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834312    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834329    4948 cpu_manager.go:414] "containerMap: removing container" podUID="2a8540f7-c0cd-4778-a5aa-9665ddd8f820" containerName="payload-pre-processing"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834336    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2a8540f7-c0cd-4778-a5aa-9665ddd8f820" containerName="payload-pre-processing"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834374    4948 cpu_manager.go:414] "containerMap: removing container" podUID="a4420d1a-5925-4097-8f45-a84c866412e4" containerName="payload-processing"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834382    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a4420d1a-5925-4097-8f45-a84c866412e4" containerName="payload-processing"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834392    4948 cpu_manager.go:414] "containerMap: removing container" podUID="1a314402-a3a6-42d4-a9d3-526b464bea78" containerName="payload-processing"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834399    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a314402-a3a6-42d4-a9d3-526b464bea78" containerName="payload-processing"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834409    4948 cpu_manager.go:414] "containerMap: removing container" podUID="ed0564b2-afd2-4b28-8a99-a0ae8f46b516" containerName="maas-api"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834416    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ed0564b2-afd2-4b28-8a99-a0ae8f46b516" containerName="maas-api"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834425    4948 cpu_manager.go:414] "containerMap: removing container" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834436    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834446    4948 cpu_manager.go:414] "containerMap: removing container" podUID="17f8a1bb-f09d-4a66-97eb-242dd0261f2b" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834453    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="17f8a1bb-f09d-4a66-97eb-242dd0261f2b" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834465    4948 cpu_manager.go:414] "containerMap: removing container" podUID="77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834472    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834482    4948 cpu_manager.go:414] "containerMap: removing container" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834489    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834507    4948 cpu_manager.go:414] "containerMap: removing container" podUID="00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834515    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834526    4948 cpu_manager.go:414] "containerMap: removing container" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834533    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834557    4948 cpu_manager.go:414] "containerMap: removing container" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834565    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834585    4948 cpu_manager.go:414] "containerMap: removing container" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834592    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834603    4948 cpu_manager.go:414] "containerMap: removing container" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834610    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834622    4948 cpu_manager.go:414] "containerMap: removing container" podUID="6473d8f0-9a33-42a1-9353-ab78fd79ba6a" containerName="manager"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834628    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6473d8f0-9a33-42a1-9353-ab78fd79ba6a" containerName="manager"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834637    4948 cpu_manager.go:414] "containerMap: removing container" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834643    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834656    4948 cpu_manager.go:414] "containerMap: removing container" podUID="17307650-956b-4f4c-be36-cbfdf82feb0d" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834663    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="17307650-956b-4f4c-be36-cbfdf82feb0d" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834672    4948 cpu_manager.go:414] "containerMap: removing container" podUID="ec5914af-5cdd-425a-a0d3-9b6ba2947947" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834679    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ec5914af-5cdd-425a-a0d3-9b6ba2947947" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834694    4948 cpu_manager.go:414] "containerMap: removing container" podUID="77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834702    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834712    4948 cpu_manager.go:414] "containerMap: removing container" podUID="7123b746-4253-4381-8585-b0090b9fbb22" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834719    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7123b746-4253-4381-8585-b0090b9fbb22" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834729    4948 cpu_manager.go:414] "containerMap: removing container" podUID="0141b4ff-f223-4fed-be7e-16f2e33ec90a" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834736    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0141b4ff-f223-4fed-be7e-16f2e33ec90a" containerName="istio-proxy"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834746    4948 cpu_manager.go:414] "containerMap: removing container" podUID="cc19cb54-92ef-4371-a1d1-2107238ea15d" containerName="maas-api"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834754    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc19cb54-92ef-4371-a1d1-2107238ea15d" containerName="maas-api"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834770    4948 cpu_manager.go:414] "containerMap: removing container" podUID="c7a5ee70-6beb-43bf-813e-d45272a970e6" containerName="payload-pre-processing"
Oct 30 21:04:01.834763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834778    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c7a5ee70-6beb-43bf-813e-d45272a970e6" containerName="payload-pre-processing"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834909    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="00ad7e60-0b7c-4c4b-9ca1-73d89b00ff54" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834921    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="315d7349-10f7-4c92-a563-b71f12c4f702" containerName="main"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834936    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="e7cf7f07-fe2a-4871-a47c-da02e96356df" containerName="main"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834952    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce51fe2f-476c-4e0e-8b93-d4d71290ed18" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834960    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad516464-a895-4e85-bd16-cf9bdcedba2d" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834969    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="6473d8f0-9a33-42a1-9353-ab78fd79ba6a" containerName="manager"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834979    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="29bd5543-e7f6-4989-877b-47efbbc7ab19" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834990    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="17307650-956b-4f4c-be36-cbfdf82feb0d" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.834999    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="ec5914af-5cdd-425a-a0d3-9b6ba2947947" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835010    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835018    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="7123b746-4253-4381-8585-b0090b9fbb22" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835028    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="0141b4ff-f223-4fed-be7e-16f2e33ec90a" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835039    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc19cb54-92ef-4371-a1d1-2107238ea15d" containerName="maas-api"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835049    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="c7a5ee70-6beb-43bf-813e-d45272a970e6" containerName="payload-pre-processing"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835058    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="f8cf36ba-7a1f-47cf-bfa3-a9e68e4b4c32" containerName="maas-api"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835066    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c9c8245-6152-4562-88da-2264625bc3da" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835076    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="21834f97-ced2-4e07-9b75-674e07e584a5" containerName="revoke-keys"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835084    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="f77b2b95-869a-4e6b-96e1-ce1382ec7896" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835093    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="a33086b6-3909-4317-ab87-877c36019f4e" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835102    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="24dd0839-321b-426a-a667-42b366bba980" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835111    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="755c4a92-3dbc-4c53-9c9e-3092071391cd" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835120    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="a93ec255-05ea-4e2e-945b-f5f360aea5cf" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835131    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="2a8540f7-c0cd-4778-a5aa-9665ddd8f820" containerName="payload-pre-processing"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835143    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="a4420d1a-5925-4097-8f45-a84c866412e4" containerName="payload-processing"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835152    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a314402-a3a6-42d4-a9d3-526b464bea78" containerName="payload-processing"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835163    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="ed0564b2-afd2-4b28-8a99-a0ae8f46b516" containerName="maas-api"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835173    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="a33086b6-3909-4317-ab87-877c36019f4e" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835183    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="aad11c1f-9bd6-4268-9759-2589245b9a91" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835191    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="17f8a1bb-f09d-4a66-97eb-242dd0261f2b" containerName="istio-proxy"
Oct 30 21:04:01.836027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.835202    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="459a9978-d5ae-419b-a4c2-ebfa6078326d" containerName="istio-proxy"
Oct 30 21:04:01.840566 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.840532    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d44b6fdc-l4hl9"
Oct 30 21:04:01.847760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.847725    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ss9s9\""
Oct 30 21:04:01.848165 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.848141    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 30 21:04:01.849850 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.849823    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 30 21:04:01.849999 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.849928    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 30 21:04:01.852135 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.852101    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55d44b6fdc-l4hl9"]
Oct 30 21:04:01.852861 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.852836    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-metrics-certs\") pod \"maas-controller-55d44b6fdc-l4hl9\" (UID: \"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6\") " pod="opendatahub/maas-controller-55d44b6fdc-l4hl9"
Oct 30 21:04:01.853027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.853004    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjphd\" (UniqueName: \"kubernetes.io/projected/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-kube-api-access-fjphd\") pod \"maas-controller-55d44b6fdc-l4hl9\" (UID: \"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6\") " pod="opendatahub/maas-controller-55d44b6fdc-l4hl9"
Oct 30 21:04:01.853234 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.853210    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-webhook-cert\") pod \"maas-controller-55d44b6fdc-l4hl9\" (UID: \"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6\") " pod="opendatahub/maas-controller-55d44b6fdc-l4hl9"
Oct 30 21:04:01.954614 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.954551    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjphd\" (UniqueName: \"kubernetes.io/projected/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-kube-api-access-fjphd\") pod \"maas-controller-55d44b6fdc-l4hl9\" (UID: \"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6\") " pod="opendatahub/maas-controller-55d44b6fdc-l4hl9"
Oct 30 21:04:01.954813 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.954640    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-webhook-cert\") pod \"maas-controller-55d44b6fdc-l4hl9\" (UID: \"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6\") " pod="opendatahub/maas-controller-55d44b6fdc-l4hl9"
Oct 30 21:04:01.954813 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.954747    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-metrics-certs\") pod \"maas-controller-55d44b6fdc-l4hl9\" (UID: \"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6\") " pod="opendatahub/maas-controller-55d44b6fdc-l4hl9"
Oct 30 21:04:01.957483 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.957453    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-webhook-cert\") pod \"maas-controller-55d44b6fdc-l4hl9\" (UID: \"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6\") " pod="opendatahub/maas-controller-55d44b6fdc-l4hl9"
Oct 30 21:04:01.957777 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.957753    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-metrics-certs\") pod \"maas-controller-55d44b6fdc-l4hl9\" (UID: \"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6\") " pod="opendatahub/maas-controller-55d44b6fdc-l4hl9"
Oct 30 21:04:01.967522 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:01.967483    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjphd\" (UniqueName: \"kubernetes.io/projected/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-kube-api-access-fjphd\") pod \"maas-controller-55d44b6fdc-l4hl9\" (UID: \"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6\") " pod="opendatahub/maas-controller-55d44b6fdc-l4hl9"
Oct 30 21:04:02.160833 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:02.160727    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d44b6fdc-l4hl9"
Oct 30 21:04:02.298890 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:02.298833    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6473d8f0-9a33-42a1-9353-ab78fd79ba6a" path="/var/lib/kubelet/pods/6473d8f0-9a33-42a1-9353-ab78fd79ba6a/volumes"
Oct 30 21:04:02.467534 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:02.467427    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55d44b6fdc-l4hl9"]
Oct 30 21:04:03.046029 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.045988    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d44b6fdc-l4hl9" event={"ID":"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6","Type":"ContainerStarted","Data":"d2b82fad7d431dea6fcce6ba0bec1c608e5b6bcf1ed1309fcaee3c581f18ed9c"}
Oct 30 21:04:03.049128 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.049095    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" event={"ID":"c6a1c4f4-5189-457f-89cb-d4b75127d7b9","Type":"ContainerDied","Data":"363c6d72bcad40b63a944dbab89c55d9ba8b93e6a2c68fd103d756ac0f5d9923"}
Oct 30 21:04:03.049344 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.048898    4948 generic.go:356] "Generic (PLEG): container finished" podID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerID="363c6d72bcad40b63a944dbab89c55d9ba8b93e6a2c68fd103d756ac0f5d9923" exitCode=0
Oct 30 21:04:03.146253 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.146157    4948 generic.go:356] "Generic (PLEG): container finished" podID="64439bcb-741d-4b5c-83c6-f04b69619331" containerID="4746de5d76e4774f6cbbbfdf3ed9fd641c11c2528f26dbae1304086efa1b91f6" exitCode=0
Oct 30 21:04:03.146455 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.146340    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw" event={"ID":"64439bcb-741d-4b5c-83c6-f04b69619331","Type":"ContainerDied","Data":"4746de5d76e4774f6cbbbfdf3ed9fd641c11c2528f26dbae1304086efa1b91f6"}
Oct 30 21:04:03.158826 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.158088    4948 generic.go:356] "Generic (PLEG): container finished" podID="cc641a0d-47aa-4281-a0f0-4caa99ac46ce" containerID="6e43bd17836d9734c313ceb9840a4f539a08dc38256ef5d53d779ee3b0f99f31" exitCode=0
Oct 30 21:04:03.158826 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.158276    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz" event={"ID":"cc641a0d-47aa-4281-a0f0-4caa99ac46ce","Type":"ContainerDied","Data":"6e43bd17836d9734c313ceb9840a4f539a08dc38256ef5d53d779ee3b0f99f31"}
Oct 30 21:04:03.197197 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.192435    4948 generic.go:356] "Generic (PLEG): container finished" podID="37aaeb67-eddf-4e41-8980-e44ed94a18eb" containerID="96c33a030c48a240c777eeee691ecc29d14aedf0d5a8a6d250c9420dcb92c64e" exitCode=0
Oct 30 21:04:03.197197 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.192531    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf" event={"ID":"37aaeb67-eddf-4e41-8980-e44ed94a18eb","Type":"ContainerDied","Data":"96c33a030c48a240c777eeee691ecc29d14aedf0d5a8a6d250c9420dcb92c64e"}
Oct 30 21:04:03.197197 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.192595    4948 scope.go:122] "RemoveContainer" containerID="f46192a4c7fb70ad68fff4efefae56bc8d4c4f0f1637ec7a09f2a111750af108"
Oct 30 21:04:03.239376 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.238910    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:04:03.456094 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.445154    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-podinfo\") pod \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") "
Oct 30 21:04:03.456094 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.445234    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-data\") pod \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") "
Oct 30 21:04:03.456094 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.445285    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-kube-api-access-nlrl9\" (UniqueName: \"kubernetes.io/projected/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-kube-api-access-nlrl9\") pod \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") "
Oct 30 21:04:03.456094 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.445350    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-envoy\") pod \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") "
Oct 30 21:04:03.456094 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.445436    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-workload-socket\") pod \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") "
Oct 30 21:04:03.456094 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.445472    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-token\" (UniqueName: \"kubernetes.io/projected/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-token\") pod \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") "
Oct 30 21:04:03.456094 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.445527    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-workload-certs\") pod \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") "
Oct 30 21:04:03.456094 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.445569    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istiod-ca-cert\") pod \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") "
Oct 30 21:04:03.456094 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.445638    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-credential-socket\") pod \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\" (UID: \"cc641a0d-47aa-4281-a0f0-4caa99ac46ce\") "
Oct 30 21:04:03.456094 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.446198    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-credential-socket" pod "cc641a0d-47aa-4281-a0f0-4caa99ac46ce" (UID: "cc641a0d-47aa-4281-a0f0-4caa99ac46ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:03.456094 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.446715    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-workload-certs" pod "cc641a0d-47aa-4281-a0f0-4caa99ac46ce" (UID: "cc641a0d-47aa-4281-a0f0-4caa99ac46ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:03.456094 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.447043    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istiod-ca-cert" pod "cc641a0d-47aa-4281-a0f0-4caa99ac46ce" (UID: "cc641a0d-47aa-4281-a0f0-4caa99ac46ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:04:03.456094 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.447088    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-data" pod "cc641a0d-47aa-4281-a0f0-4caa99ac46ce" (UID: "cc641a0d-47aa-4281-a0f0-4caa99ac46ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:03.456094 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.447307    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-workload-socket" pod "cc641a0d-47aa-4281-a0f0-4caa99ac46ce" (UID: "cc641a0d-47aa-4281-a0f0-4caa99ac46ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:03.479424 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.479206    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-token" pod "cc641a0d-47aa-4281-a0f0-4caa99ac46ce" (UID: "cc641a0d-47aa-4281-a0f0-4caa99ac46ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:03.479424 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.479374    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-envoy" pod "cc641a0d-47aa-4281-a0f0-4caa99ac46ce" (UID: "cc641a0d-47aa-4281-a0f0-4caa99ac46ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:03.519388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.505616    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-kube-api-access-nlrl9" pod "cc641a0d-47aa-4281-a0f0-4caa99ac46ce" (UID: "cc641a0d-47aa-4281-a0f0-4caa99ac46ce"). InnerVolumeSpecName "kube-api-access-nlrl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:03.519388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.518591    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-podinfo" pod "cc641a0d-47aa-4281-a0f0-4caa99ac46ce" (UID: "cc641a0d-47aa-4281-a0f0-4caa99ac46ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:04:03.547649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.547453    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.547649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.547496    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.547649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.547512    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.547649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.547528    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlrl9\" (UniqueName: \"kubernetes.io/projected/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-kube-api-access-nlrl9\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.547649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.547546    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.547649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.547561    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.547649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.547575    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.547649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.547589    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.547649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.547604    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc641a0d-47aa-4281-a0f0-4caa99ac46ce-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.702416 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.689741    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:04:03.749321 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.749166    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-credential-socket\") pod \"64439bcb-741d-4b5c-83c6-f04b69619331\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") "
Oct 30 21:04:03.749321 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.749246    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-workload-socket\") pod \"64439bcb-741d-4b5c-83c6-f04b69619331\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") "
Oct 30 21:04:03.749321 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.749318    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-istio-data\") pod \"64439bcb-741d-4b5c-83c6-f04b69619331\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") "
Oct 30 21:04:03.749666 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.749573    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-credential-socket" pod "64439bcb-741d-4b5c-83c6-f04b69619331" (UID: "64439bcb-741d-4b5c-83c6-f04b69619331"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:03.749906 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.749838    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-workload-socket" pod "64439bcb-741d-4b5c-83c6-f04b69619331" (UID: "64439bcb-741d-4b5c-83c6-f04b69619331"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:03.753471 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.753423    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64439bcb-741d-4b5c-83c6-f04b69619331-kube-api-access-q5bkr\" (UniqueName: \"kubernetes.io/projected/64439bcb-741d-4b5c-83c6-f04b69619331-kube-api-access-q5bkr\") pod \"64439bcb-741d-4b5c-83c6-f04b69619331\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") "
Oct 30 21:04:03.769703 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.769609    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-istio-envoy\") pod \"64439bcb-741d-4b5c-83c6-f04b69619331\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") "
Oct 30 21:04:03.790786 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.770016    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-istio-data" pod "64439bcb-741d-4b5c-83c6-f04b69619331" (UID: "64439bcb-741d-4b5c-83c6-f04b69619331"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:03.791199 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.791173    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/64439bcb-741d-4b5c-83c6-f04b69619331-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64439bcb-741d-4b5c-83c6-f04b69619331-istio-podinfo\") pod \"64439bcb-741d-4b5c-83c6-f04b69619331\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") "
Oct 30 21:04:03.792056 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.792035    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-workload-certs\") pod \"64439bcb-741d-4b5c-83c6-f04b69619331\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") "
Oct 30 21:04:03.837891 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.792473    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-workload-certs" pod "64439bcb-741d-4b5c-83c6-f04b69619331" (UID: "64439bcb-741d-4b5c-83c6-f04b69619331"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:03.837891 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.804676    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64439bcb-741d-4b5c-83c6-f04b69619331-istiod-ca-cert" pod "64439bcb-741d-4b5c-83c6-f04b69619331" (UID: "64439bcb-741d-4b5c-83c6-f04b69619331"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:04:03.837891 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.837490    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 21:04:03.837891 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.792574    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/64439bcb-741d-4b5c-83c6-f04b69619331-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64439bcb-741d-4b5c-83c6-f04b69619331-istiod-ca-cert\") pod \"64439bcb-741d-4b5c-83c6-f04b69619331\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") "
Oct 30 21:04:03.837891 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.837579    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64439bcb-741d-4b5c-83c6-f04b69619331-istio-token\" (UniqueName: \"kubernetes.io/projected/64439bcb-741d-4b5c-83c6-f04b69619331-istio-token\") pod \"64439bcb-741d-4b5c-83c6-f04b69619331\" (UID: \"64439bcb-741d-4b5c-83c6-f04b69619331\") "
Oct 30 21:04:03.838388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.838110    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.838388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.838139    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64439bcb-741d-4b5c-83c6-f04b69619331-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.838388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.838158    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.838388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.838173    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.838388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.838188    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.842396 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.840618    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-istio-envoy" pod "64439bcb-741d-4b5c-83c6-f04b69619331" (UID: "64439bcb-741d-4b5c-83c6-f04b69619331"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:03.842396 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.842185    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64439bcb-741d-4b5c-83c6-f04b69619331-kube-api-access-q5bkr" pod "64439bcb-741d-4b5c-83c6-f04b69619331" (UID: "64439bcb-741d-4b5c-83c6-f04b69619331"). InnerVolumeSpecName "kube-api-access-q5bkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:03.842396 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.842275    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64439bcb-741d-4b5c-83c6-f04b69619331-istio-token" pod "64439bcb-741d-4b5c-83c6-f04b69619331" (UID: "64439bcb-741d-4b5c-83c6-f04b69619331"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:03.842396 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.842294    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64439bcb-741d-4b5c-83c6-f04b69619331-istio-podinfo" pod "64439bcb-741d-4b5c-83c6-f04b69619331" (UID: "64439bcb-741d-4b5c-83c6-f04b69619331"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:04:03.941540 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.941501    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-credential-socket\") pod \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") "
Oct 30 21:04:03.941770 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.941549    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-workload-certs\") pod \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") "
Oct 30 21:04:03.941770 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.941585    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-token\" (UniqueName: \"kubernetes.io/projected/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-token\") pod \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") "
Oct 30 21:04:03.941770 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.941649    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-workload-socket\") pod \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") "
Oct 30 21:04:03.941770 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.941681    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-data\") pod \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") "
Oct 30 21:04:03.941770 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.941719    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istiod-ca-cert\") pod \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") "
Oct 30 21:04:03.942024 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.941788    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37aaeb67-eddf-4e41-8980-e44ed94a18eb-kube-api-access-7wz29\" (UniqueName: \"kubernetes.io/projected/37aaeb67-eddf-4e41-8980-e44ed94a18eb-kube-api-access-7wz29\") pod \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") "
Oct 30 21:04:03.942024 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.941848    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-podinfo\") pod \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") "
Oct 30 21:04:03.942024 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.941948    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-envoy\") pod \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\" (UID: \"37aaeb67-eddf-4e41-8980-e44ed94a18eb\") "
Oct 30 21:04:03.942444 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.942424    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5bkr\" (UniqueName: \"kubernetes.io/projected/64439bcb-741d-4b5c-83c6-f04b69619331-kube-api-access-q5bkr\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.942541 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.942448    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64439bcb-741d-4b5c-83c6-f04b69619331-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.942541 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.942471    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64439bcb-741d-4b5c-83c6-f04b69619331-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.942541 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.942485    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64439bcb-741d-4b5c-83c6-f04b69619331-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:03.945055 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.945023    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-workload-socket" pod "37aaeb67-eddf-4e41-8980-e44ed94a18eb" (UID: "37aaeb67-eddf-4e41-8980-e44ed94a18eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:03.945527 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.945501    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:04:03.946024 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.945650    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-credential-socket" pod "37aaeb67-eddf-4e41-8980-e44ed94a18eb" (UID: "37aaeb67-eddf-4e41-8980-e44ed94a18eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:03.946261 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.945701    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-workload-certs" pod "37aaeb67-eddf-4e41-8980-e44ed94a18eb" (UID: "37aaeb67-eddf-4e41-8980-e44ed94a18eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:03.946375 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.945991    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istiod-ca-cert" pod "37aaeb67-eddf-4e41-8980-e44ed94a18eb" (UID: "37aaeb67-eddf-4e41-8980-e44ed94a18eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:04:03.946494 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.946067    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-data" pod "37aaeb67-eddf-4e41-8980-e44ed94a18eb" (UID: "37aaeb67-eddf-4e41-8980-e44ed94a18eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:03.946596 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.946019    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-envoy" pod "37aaeb67-eddf-4e41-8980-e44ed94a18eb" (UID: "37aaeb67-eddf-4e41-8980-e44ed94a18eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:03.948655 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.948627    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-token" pod "37aaeb67-eddf-4e41-8980-e44ed94a18eb" (UID: "37aaeb67-eddf-4e41-8980-e44ed94a18eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:03.950676 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.950646    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37aaeb67-eddf-4e41-8980-e44ed94a18eb-kube-api-access-7wz29" pod "37aaeb67-eddf-4e41-8980-e44ed94a18eb" (UID: "37aaeb67-eddf-4e41-8980-e44ed94a18eb"). InnerVolumeSpecName "kube-api-access-7wz29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:03.982136 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:03.981584    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-podinfo" pod "37aaeb67-eddf-4e41-8980-e44ed94a18eb" (UID: "37aaeb67-eddf-4e41-8980-e44ed94a18eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.043948    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-credential-socket\") pod \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") "
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.044058    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istiod-ca-cert\") pod \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") "
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.044118    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-workload-certs\") pod \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") "
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.044170    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-kube-api-access-rk7s2\" (UniqueName: \"kubernetes.io/projected/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-kube-api-access-rk7s2\") pod \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") "
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.044245    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-workload-socket\") pod \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") "
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.044291    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-envoy\") pod \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") "
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.044398    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-token\" (UniqueName: \"kubernetes.io/projected/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-token\") pod \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") "
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.044436    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-data\") pod \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") "
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.044508    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-podinfo\") pod \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\" (UID: \"c6a1c4f4-5189-457f-89cb-d4b75127d7b9\") "
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.045123    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.045146    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.045163    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.045187    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.045205    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.045221    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.045239    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.045259    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37aaeb67-eddf-4e41-8980-e44ed94a18eb-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.045276    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wz29\" (UniqueName: \"kubernetes.io/projected/37aaeb67-eddf-4e41-8980-e44ed94a18eb-kube-api-access-7wz29\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.047162    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-workload-socket" pod "c6a1c4f4-5189-457f-89cb-d4b75127d7b9" (UID: "c6a1c4f4-5189-457f-89cb-d4b75127d7b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.047602    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istiod-ca-cert" pod "c6a1c4f4-5189-457f-89cb-d4b75127d7b9" (UID: "c6a1c4f4-5189-457f-89cb-d4b75127d7b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.047914    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-credential-socket" pod "c6a1c4f4-5189-457f-89cb-d4b75127d7b9" (UID: "c6a1c4f4-5189-457f-89cb-d4b75127d7b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.048579    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-data" pod "c6a1c4f4-5189-457f-89cb-d4b75127d7b9" (UID: "c6a1c4f4-5189-457f-89cb-d4b75127d7b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.048808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.048653    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-workload-certs" pod "c6a1c4f4-5189-457f-89cb-d4b75127d7b9" (UID: "c6a1c4f4-5189-457f-89cb-d4b75127d7b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.108498 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.067029    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-token" pod "c6a1c4f4-5189-457f-89cb-d4b75127d7b9" (UID: "c6a1c4f4-5189-457f-89cb-d4b75127d7b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:04.108498 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.089745    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-podinfo" pod "c6a1c4f4-5189-457f-89cb-d4b75127d7b9" (UID: "c6a1c4f4-5189-457f-89cb-d4b75127d7b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:04:04.108498 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.095000    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-kube-api-access-rk7s2" pod "c6a1c4f4-5189-457f-89cb-d4b75127d7b9" (UID: "c6a1c4f4-5189-457f-89cb-d4b75127d7b9"). InnerVolumeSpecName "kube-api-access-rk7s2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:04.112083 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.112003    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-envoy" pod "c6a1c4f4-5189-457f-89cb-d4b75127d7b9" (UID: "c6a1c4f4-5189-457f-89cb-d4b75127d7b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.146144 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.145963    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.146144 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.146005    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.146144 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.146023    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.146144 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.146038    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.146144 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.146054    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rk7s2\" (UniqueName: \"kubernetes.io/projected/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-kube-api-access-rk7s2\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.146144 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.146071    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.146144 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.146085    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.146144 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.146098    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.146144 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.146114    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6a1c4f4-5189-457f-89cb-d4b75127d7b9-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.202274 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.202222    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d44b6fdc-l4hl9" event={"ID":"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6","Type":"ContainerStarted","Data":"edb3d27bcf3b8cea359ad436fc4f45218dfb37f38ddc448a82e86b9f11fa48eb"}
Oct 30 21:04:04.204674 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.204342    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"
Oct 30 21:04:04.204674 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.204412    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p" event={"ID":"c6a1c4f4-5189-457f-89cb-d4b75127d7b9","Type":"ContainerDied","Data":"59fbf8af0e69214507e906b0aaa7da685603645891026b92f6b0c68319c0e3cf"}
Oct 30 21:04:04.204674 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.204512    4948 scope.go:122] "RemoveContainer" containerID="363c6d72bcad40b63a944dbab89c55d9ba8b93e6a2c68fd103d756ac0f5d9923"
Oct 30 21:04:04.207486 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.207405    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw" event={"ID":"64439bcb-741d-4b5c-83c6-f04b69619331","Type":"ContainerDied","Data":"d696c372a4fcb2f8fd2539a6c583fff9930895b75f6c2168d833dd554c3bcee0"}
Oct 30 21:04:04.207705 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.207688    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"
Oct 30 21:04:04.209511 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.209475    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz" event={"ID":"cc641a0d-47aa-4281-a0f0-4caa99ac46ce","Type":"ContainerDied","Data":"d9836d3f2101e428abdead672d005b4b1e85358833d462da891b440a21f19f14"}
Oct 30 21:04:04.209828 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.209798    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"
Oct 30 21:04:04.216469 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.213506    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf" event={"ID":"37aaeb67-eddf-4e41-8980-e44ed94a18eb","Type":"ContainerDied","Data":"aa3ae6e56e017b107ba9352c158aacd7c04a1e1483071bb0b51d6960ba107044"}
Oct 30 21:04:04.216469 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.213642    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"
Oct 30 21:04:04.231171 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.231096    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-55d44b6fdc-l4hl9" podStartSLOduration=2.302401487 podStartE2EDuration="3.231073449s" totalImagesPullingTime="928.671962ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:04:04.228609376 +0000 UTC m=+1512.048121368" watchObservedRunningTime="2026-10-30 21:04:04.231073449 +0000 UTC m=+1512.050585438"
Oct 30 21:04:04.234253 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.234227    4948 scope.go:122] "RemoveContainer" containerID="4746de5d76e4774f6cbbbfdf3ed9fd641c11c2528f26dbae1304086efa1b91f6"
Oct 30 21:04:04.247350 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.247325    4948 scope.go:122] "RemoveContainer" containerID="6e43bd17836d9734c313ceb9840a4f539a08dc38256ef5d53d779ee3b0f99f31"
Oct 30 21:04:04.257516 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.257477    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"]
Oct 30 21:04:04.258635 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.258614    4948 scope.go:122] "RemoveContainer" containerID="96c33a030c48a240c777eeee691ecc29d14aedf0d5a8a6d250c9420dcb92c64e"
Oct 30 21:04:04.265881 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.265841    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-x4z6p"]
Oct 30 21:04:04.278040 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.277999    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"]
Oct 30 21:04:04.294759 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.294724    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" path="/var/lib/kubelet/pods/c6a1c4f4-5189-457f-89cb-d4b75127d7b9/volumes"
Oct 30 21:04:04.295039 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.295025    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-4qzkw"]
Oct 30 21:04:04.307069 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.306979    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"]
Oct 30 21:04:04.310716 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.310682    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-8qjgz"]
Oct 30 21:04:04.331999 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.331954    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"]
Oct 30 21:04:04.335043 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:04.335010    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-7hfqf"]
Oct 30 21:04:05.223242 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:05.223206    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55d44b6fdc-l4hl9"
Oct 30 21:04:06.293491 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:06.293457    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="37aaeb67-eddf-4e41-8980-e44ed94a18eb" path="/var/lib/kubelet/pods/37aaeb67-eddf-4e41-8980-e44ed94a18eb/volumes"
Oct 30 21:04:06.293973 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:06.293957    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="64439bcb-741d-4b5c-83c6-f04b69619331" path="/var/lib/kubelet/pods/64439bcb-741d-4b5c-83c6-f04b69619331/volumes"
Oct 30 21:04:06.294384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:06.294347    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cc641a0d-47aa-4281-a0f0-4caa99ac46ce" path="/var/lib/kubelet/pods/cc641a0d-47aa-4281-a0f0-4caa99ac46ce/volumes"
Oct 30 21:04:06.365979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:06.365936    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:04:07.782577 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:07.782539    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:04:13.351847 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:13.351807    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:04:16.235184 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:16.235146    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55d44b6fdc-l4hl9"
Oct 30 21:04:23.929951 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:04:23.929905    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:04:27.144911 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:27.144860    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:04:34.907183 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:34.907136    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55d44b6fdc-l4hl9"]
Oct 30 21:04:34.907692 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:34.907386    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-55d44b6fdc-l4hl9" podUID="c1e554c0-857b-45b3-b612-b1ca6ed8c0d6" containerName="manager" containerID="cri-o://edb3d27bcf3b8cea359ad436fc4f45218dfb37f38ddc448a82e86b9f11fa48eb" gracePeriod=30
Oct 30 21:04:35.150867 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.150821    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:04:35.179835 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.179796    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d44b6fdc-l4hl9"
Oct 30 21:04:35.264017 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.263978    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-kube-api-access-fjphd\" (UniqueName: \"kubernetes.io/projected/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-kube-api-access-fjphd\") pod \"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6\" (UID: \"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6\") "
Oct 30 21:04:35.264230 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.264034    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-metrics-certs\") pod \"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6\" (UID: \"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6\") "
Oct 30 21:04:35.264230 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.264125    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-webhook-cert\") pod \"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6\" (UID: \"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6\") "
Oct 30 21:04:35.266410 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.266340    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-metrics-certs" pod "c1e554c0-857b-45b3-b612-b1ca6ed8c0d6" (UID: "c1e554c0-857b-45b3-b612-b1ca6ed8c0d6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:04:35.266410 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.266383    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-webhook-cert" pod "c1e554c0-857b-45b3-b612-b1ca6ed8c0d6" (UID: "c1e554c0-857b-45b3-b612-b1ca6ed8c0d6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:04:35.266587 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.266438    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-kube-api-access-fjphd" pod "c1e554c0-857b-45b3-b612-b1ca6ed8c0d6" (UID: "c1e554c0-857b-45b3-b612-b1ca6ed8c0d6"). InnerVolumeSpecName "kube-api-access-fjphd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:35.365054 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.364992    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjphd\" (UniqueName: \"kubernetes.io/projected/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-kube-api-access-fjphd\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:35.365054 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.365054    4948 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-metrics-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:35.365054 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.365068    4948 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6-webhook-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:35.385701 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.385665    4948 generic.go:356] "Generic (PLEG): container finished" podID="c1e554c0-857b-45b3-b612-b1ca6ed8c0d6" containerID="edb3d27bcf3b8cea359ad436fc4f45218dfb37f38ddc448a82e86b9f11fa48eb" exitCode=0
Oct 30 21:04:35.385893 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.385719    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d44b6fdc-l4hl9"
Oct 30 21:04:35.385893 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.385748    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d44b6fdc-l4hl9" event={"ID":"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6","Type":"ContainerDied","Data":"edb3d27bcf3b8cea359ad436fc4f45218dfb37f38ddc448a82e86b9f11fa48eb"}
Oct 30 21:04:35.385893 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.385804    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d44b6fdc-l4hl9" event={"ID":"c1e554c0-857b-45b3-b612-b1ca6ed8c0d6","Type":"ContainerDied","Data":"d2b82fad7d431dea6fcce6ba0bec1c608e5b6bcf1ed1309fcaee3c581f18ed9c"}
Oct 30 21:04:35.385893 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.385829    4948 scope.go:122] "RemoveContainer" containerID="edb3d27bcf3b8cea359ad436fc4f45218dfb37f38ddc448a82e86b9f11fa48eb"
Oct 30 21:04:35.396694 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.396670    4948 scope.go:122] "RemoveContainer" containerID="edb3d27bcf3b8cea359ad436fc4f45218dfb37f38ddc448a82e86b9f11fa48eb"
Oct 30 21:04:35.397077 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:04:35.397054    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edb3d27bcf3b8cea359ad436fc4f45218dfb37f38ddc448a82e86b9f11fa48eb\": container with ID starting with edb3d27bcf3b8cea359ad436fc4f45218dfb37f38ddc448a82e86b9f11fa48eb not found: ID does not exist" containerID="edb3d27bcf3b8cea359ad436fc4f45218dfb37f38ddc448a82e86b9f11fa48eb"
Oct 30 21:04:35.397139 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.397090    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edb3d27bcf3b8cea359ad436fc4f45218dfb37f38ddc448a82e86b9f11fa48eb"} err="failed to get container status \"edb3d27bcf3b8cea359ad436fc4f45218dfb37f38ddc448a82e86b9f11fa48eb\": rpc error: code = NotFound desc = could not find container \"edb3d27bcf3b8cea359ad436fc4f45218dfb37f38ddc448a82e86b9f11fa48eb\": container with ID starting with edb3d27bcf3b8cea359ad436fc4f45218dfb37f38ddc448a82e86b9f11fa48eb not found: ID does not exist"
Oct 30 21:04:35.411667 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.411586    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55d44b6fdc-l4hl9"]
Oct 30 21:04:35.415734 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:35.415698    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55d44b6fdc-l4hl9"]
Oct 30 21:04:36.293017 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.292978    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c1e554c0-857b-45b3-b612-b1ca6ed8c0d6" path="/var/lib/kubelet/pods/c1e554c0-857b-45b3-b612-b1ca6ed8c0d6/volumes"
Oct 30 21:04:36.619744 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.619708    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:04:36.694813 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.694770    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55d44b6fdc-wndvd"]
Oct 30 21:04:36.695205 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695191    4948 cpu_manager.go:414] "containerMap: removing container" podUID="37aaeb67-eddf-4e41-8980-e44ed94a18eb" containerName="istio-proxy"
Oct 30 21:04:36.695259 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695206    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="37aaeb67-eddf-4e41-8980-e44ed94a18eb" containerName="istio-proxy"
Oct 30 21:04:36.695259 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695218    4948 cpu_manager.go:414] "containerMap: removing container" podUID="a33086b6-3909-4317-ab87-877c36019f4e" containerName="istio-proxy"
Oct 30 21:04:36.695259 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695224    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a33086b6-3909-4317-ab87-877c36019f4e" containerName="istio-proxy"
Oct 30 21:04:36.695259 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695236    4948 cpu_manager.go:414] "containerMap: removing container" podUID="c1e554c0-857b-45b3-b612-b1ca6ed8c0d6" containerName="manager"
Oct 30 21:04:36.695259 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695241    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1e554c0-857b-45b3-b612-b1ca6ed8c0d6" containerName="manager"
Oct 30 21:04:36.695259 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695256    4948 cpu_manager.go:414] "containerMap: removing container" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy"
Oct 30 21:04:36.695259 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695261    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy"
Oct 30 21:04:36.695529 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695281    4948 cpu_manager.go:414] "containerMap: removing container" podUID="cc641a0d-47aa-4281-a0f0-4caa99ac46ce" containerName="istio-proxy"
Oct 30 21:04:36.695529 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695287    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc641a0d-47aa-4281-a0f0-4caa99ac46ce" containerName="istio-proxy"
Oct 30 21:04:36.695529 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695301    4948 cpu_manager.go:414] "containerMap: removing container" podUID="64439bcb-741d-4b5c-83c6-f04b69619331" containerName="istio-proxy"
Oct 30 21:04:36.695529 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695306    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64439bcb-741d-4b5c-83c6-f04b69619331" containerName="istio-proxy"
Oct 30 21:04:36.695529 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695377    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="37aaeb67-eddf-4e41-8980-e44ed94a18eb" containerName="istio-proxy"
Oct 30 21:04:36.695529 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695387    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc641a0d-47aa-4281-a0f0-4caa99ac46ce" containerName="istio-proxy"
Oct 30 21:04:36.695529 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695398    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="77b3e05d-d55b-4cc3-b1fb-502fd5b2b450" containerName="istio-proxy"
Oct 30 21:04:36.695529 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695408    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="64439bcb-741d-4b5c-83c6-f04b69619331" containerName="istio-proxy"
Oct 30 21:04:36.695529 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695415    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="c1e554c0-857b-45b3-b612-b1ca6ed8c0d6" containerName="manager"
Oct 30 21:04:36.695529 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.695423    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="c6a1c4f4-5189-457f-89cb-d4b75127d7b9" containerName="istio-proxy"
Oct 30 21:04:36.700026 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.700001    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d44b6fdc-wndvd"
Oct 30 21:04:36.724071 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.724038    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 30 21:04:36.724733 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.724716    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 30 21:04:36.724826 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.724733    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 30 21:04:36.725558 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.725538    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ss9s9\""
Oct 30 21:04:36.747258 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.747223    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55d44b6fdc-wndvd"]
Oct 30 21:04:36.779880 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.779838    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f023841c-b373-4ee6-be04-ba2e79ab6bf0-metrics-certs\") pod \"maas-controller-55d44b6fdc-wndvd\" (UID: \"f023841c-b373-4ee6-be04-ba2e79ab6bf0\") " pod="opendatahub/maas-controller-55d44b6fdc-wndvd"
Oct 30 21:04:36.780095 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.779890    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8s4m\" (UniqueName: \"kubernetes.io/projected/f023841c-b373-4ee6-be04-ba2e79ab6bf0-kube-api-access-n8s4m\") pod \"maas-controller-55d44b6fdc-wndvd\" (UID: \"f023841c-b373-4ee6-be04-ba2e79ab6bf0\") " pod="opendatahub/maas-controller-55d44b6fdc-wndvd"
Oct 30 21:04:36.780095 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.780014    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f023841c-b373-4ee6-be04-ba2e79ab6bf0-webhook-cert\") pod \"maas-controller-55d44b6fdc-wndvd\" (UID: \"f023841c-b373-4ee6-be04-ba2e79ab6bf0\") " pod="opendatahub/maas-controller-55d44b6fdc-wndvd"
Oct 30 21:04:36.881137 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.881028    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f023841c-b373-4ee6-be04-ba2e79ab6bf0-metrics-certs\") pod \"maas-controller-55d44b6fdc-wndvd\" (UID: \"f023841c-b373-4ee6-be04-ba2e79ab6bf0\") " pod="opendatahub/maas-controller-55d44b6fdc-wndvd"
Oct 30 21:04:36.881137 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.881089    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8s4m\" (UniqueName: \"kubernetes.io/projected/f023841c-b373-4ee6-be04-ba2e79ab6bf0-kube-api-access-n8s4m\") pod \"maas-controller-55d44b6fdc-wndvd\" (UID: \"f023841c-b373-4ee6-be04-ba2e79ab6bf0\") " pod="opendatahub/maas-controller-55d44b6fdc-wndvd"
Oct 30 21:04:36.881137 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.881139    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f023841c-b373-4ee6-be04-ba2e79ab6bf0-webhook-cert\") pod \"maas-controller-55d44b6fdc-wndvd\" (UID: \"f023841c-b373-4ee6-be04-ba2e79ab6bf0\") " pod="opendatahub/maas-controller-55d44b6fdc-wndvd"
Oct 30 21:04:36.883880 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.883845    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f023841c-b373-4ee6-be04-ba2e79ab6bf0-webhook-cert\") pod \"maas-controller-55d44b6fdc-wndvd\" (UID: \"f023841c-b373-4ee6-be04-ba2e79ab6bf0\") " pod="opendatahub/maas-controller-55d44b6fdc-wndvd"
Oct 30 21:04:36.884022 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.883884    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f023841c-b373-4ee6-be04-ba2e79ab6bf0-metrics-certs\") pod \"maas-controller-55d44b6fdc-wndvd\" (UID: \"f023841c-b373-4ee6-be04-ba2e79ab6bf0\") " pod="opendatahub/maas-controller-55d44b6fdc-wndvd"
Oct 30 21:04:36.893858 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:36.893824    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8s4m\" (UniqueName: \"kubernetes.io/projected/f023841c-b373-4ee6-be04-ba2e79ab6bf0-kube-api-access-n8s4m\") pod \"maas-controller-55d44b6fdc-wndvd\" (UID: \"f023841c-b373-4ee6-be04-ba2e79ab6bf0\") " pod="opendatahub/maas-controller-55d44b6fdc-wndvd"
Oct 30 21:04:37.014049 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:37.014003    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d44b6fdc-wndvd"
Oct 30 21:04:37.296744 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:37.296715    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55d44b6fdc-wndvd"]
Oct 30 21:04:37.298810 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:04:37.298775    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf023841c_b373_4ee6_be04_ba2e79ab6bf0.slice/crio-cbfa790787bfd06e40f5370164bc5aa9cd92ff06d1b3b32d38303faa504f8864 WatchSource:0}: Error finding container cbfa790787bfd06e40f5370164bc5aa9cd92ff06d1b3b32d38303faa504f8864: Status 404 returned error can't find the container with id cbfa790787bfd06e40f5370164bc5aa9cd92ff06d1b3b32d38303faa504f8864
Oct 30 21:04:37.398107 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:37.398073    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d44b6fdc-wndvd" event={"ID":"f023841c-b373-4ee6-be04-ba2e79ab6bf0","Type":"ContainerStarted","Data":"cbfa790787bfd06e40f5370164bc5aa9cd92ff06d1b3b32d38303faa504f8864"}
Oct 30 21:04:37.477157 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:37.477124    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:04:37.674799 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:37.674764    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:04:38.405816 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:38.405779    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d44b6fdc-wndvd" event={"ID":"f023841c-b373-4ee6-be04-ba2e79ab6bf0","Type":"ContainerStarted","Data":"6d58b43d84fe60c8c77eaeb954900276b4137b42fc14d84b3398342338a2bb20"}
Oct 30 21:04:38.406389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:38.405913    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55d44b6fdc-wndvd"
Oct 30 21:04:38.428631 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:38.428553    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-55d44b6fdc-wndvd" podStartSLOduration=1.952719975 podStartE2EDuration="2.428529496s" totalImagesPullingTime="475.809521ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:04:38.426403697 +0000 UTC m=+1546.245915686" watchObservedRunningTime="2026-10-30 21:04:38.428529496 +0000 UTC m=+1546.248041487"
Oct 30 21:04:44.379248 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:44.379209    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:04:49.413440 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:04:49.413407    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55d44b6fdc-wndvd"
Oct 30 21:04:53.929491 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:04:53.929447    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:05:23.929816 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:05:23.929771    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:05:44.431451 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:05:44.431409    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:05:53.928127 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:05:53.928079    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:06:23.929279 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:06:23.929233    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:06:35.897137 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:06:35.897035    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:06:36.099781 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:06:36.099725    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:06:40.014390 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:06:40.012900    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-qzbl9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:06:40.014390 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:06:40.012987    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9" podUID="4beb25f6-a162-490a-9695-700ce6cc8d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:06:44.480509 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:06:44.480469    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:06:53.930205 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:06:53.930157    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:07:19.449662 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:07:19.449602    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-ls72z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:07:19.450510 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:07:19.450456    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z" podUID="14f0cd2f-1f47-44dc-a972-e3be6850859e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:07:23.929221 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:07:23.929178    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:07:44.551385 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:07:44.551318    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:07:50.022691 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:07:50.022639    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"]
Oct 30 21:07:50.025499 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:07:50.025466    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ca0e90c3-7slxj"]
Oct 30 21:07:50.295165 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:07:50.295063    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="21834f97-ced2-4e07-9b75-674e07e584a5" path="/var/lib/kubelet/pods/21834f97-ced2-4e07-9b75-674e07e584a5/volumes"
Oct 30 21:07:53.929703 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:07:53.929659    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:08:04.458710 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:08:04.458437    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-ls72z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:08:04.461332 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:08:04.459306    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z" podUID="14f0cd2f-1f47-44dc-a972-e3be6850859e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:08:05.248526 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:08:05.248482    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:08:23.929810 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:08:23.929765    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:08:44.608035 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:08:44.607989    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:08:52.557639 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:08:52.557609    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 21:08:52.559674 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:08:52.559646    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 21:08:53.282009 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:08:53.281949    4948 scope.go:122] "RemoveContainer" containerID="07a54e817777009128af82a712429799a13c5ab0220124c302bbec7a1bceadce"
Oct 30 21:08:53.331179 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:08:53.331147    4948 scope.go:122] "RemoveContainer" containerID="4b4115d944619f344a20838edebb33ce89e0556f59ea25b2f677dd0e5ad59dde"
Oct 30 21:08:53.947414 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:08:53.947375    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:09:23.928680 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:09:23.928633    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:09:44.671562 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:09:44.671521    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:09:53.929293 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:09:53.929250    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:10:10.569195 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:10:10.569143    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:10:23.930129 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:10:23.930086    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:10:44.720915 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:10:44.720866    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:10:53.929182 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:10:53.929130    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:11:02.026004 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:11:02.025957    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:23.928887 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:11:23.928840    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:11:44.783088 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:11:44.783049    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:47.654816 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:11:47.654770    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:11:53.930530 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:11:53.930486    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:12:23.929575 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:12:23.929528    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:12:44.840580 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:12:44.840486    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:12:53.929016 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:12:53.928977    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:13:07.979862 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:13:07.979820    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:13:23.930155 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:13:23.930111    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:13:24.999425 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:13:24.999386    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:13:44.892391 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:13:44.892326    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:13:52.590486 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:13:52.590453    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 21:13:52.594268 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:13:52.594236    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 21:13:53.929498 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:13:53.929454    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:14:23.929676 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:14:23.929634    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:14:25.926324 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:25.926282    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"]
Oct 30 21:14:25.926849 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:25.926628    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9" podUID="4beb25f6-a162-490a-9695-700ce6cc8d46" containerName="istio-proxy" containerID="cri-o://c29c24a3a4eb29a4a749a46015a04472d89b316cbe3f387d91526fbee61548d2" gracePeriod=30
Oct 30 21:14:25.928498 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:25.928471    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"]
Oct 30 21:14:25.928781 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:25.928739    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8" podUID="f3258410-eddc-4436-bbf8-73042e516c88" containerName="istio-proxy" containerID="cri-o://e78755941921f5522c99272b195da86d01869af8720ad12284e8001f0dc2ca47" gracePeriod=30
Oct 30 21:14:25.934198 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:25.934162    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"]
Oct 30 21:14:25.934470 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:25.934424    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z" podUID="14f0cd2f-1f47-44dc-a972-e3be6850859e" containerName="istio-proxy" containerID="cri-o://49a923826b0a0433dcb1011eba7ff1e488dd5ff1d539ba4627854f58312e16fe" gracePeriod=30
Oct 30 21:14:27.926769 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:27.926726    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:28.183843 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.183750    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"]
Oct 30 21:14:28.184228 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.184215    4948 cpu_manager.go:414] "containerMap: removing container" podUID="37aaeb67-eddf-4e41-8980-e44ed94a18eb" containerName="istio-proxy"
Oct 30 21:14:28.184282 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.184230    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="37aaeb67-eddf-4e41-8980-e44ed94a18eb" containerName="istio-proxy"
Oct 30 21:14:28.184320 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.184304    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="37aaeb67-eddf-4e41-8980-e44ed94a18eb" containerName="istio-proxy"
Oct 30 21:14:28.187720 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.187678    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.191671 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.191638    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-single-main-49a6a4-openshift-default-dockercfg-qt9cq\""
Oct 30 21:14:28.200454 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.200418    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"]
Oct 30 21:14:28.292654 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.292594    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-workload-certs\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.292892 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.292684    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk7xg\" (UniqueName: \"kubernetes.io/projected/b146d379-1e46-4114-8ff5-d5406924fc24-kube-api-access-tk7xg\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.292892 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.292730    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b146d379-1e46-4114-8ff5-d5406924fc24-istiod-ca-cert\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.292892 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.292788    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-credential-socket\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.292892 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.292830    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b146d379-1e46-4114-8ff5-d5406924fc24-istio-podinfo\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.293147 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.292891    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-istio-data\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.293147 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.292971    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b146d379-1e46-4114-8ff5-d5406924fc24-istio-token\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.293147 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.293013    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-istio-envoy\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.293147 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.293054    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-workload-socket\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.329752 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.329707    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:28.393765 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.393712    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b146d379-1e46-4114-8ff5-d5406924fc24-istio-token\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.393765 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.393772    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-istio-envoy\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.394085 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.393824    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-workload-socket\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.394085 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.393994    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-workload-certs\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.394085 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.394050    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk7xg\" (UniqueName: \"kubernetes.io/projected/b146d379-1e46-4114-8ff5-d5406924fc24-kube-api-access-tk7xg\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.394262 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.394146    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b146d379-1e46-4114-8ff5-d5406924fc24-istiod-ca-cert\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.394262 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.394176    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-credential-socket\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.394262 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.394222    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b146d379-1e46-4114-8ff5-d5406924fc24-istio-podinfo\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.394458 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.394315    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-istio-data\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.394458 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.394434    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-workload-certs\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.394699 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.394674    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-workload-socket\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.394783 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.394764    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-istio-data\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.394843 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.394808    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-credential-socket\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.395005 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.394977    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b146d379-1e46-4114-8ff5-d5406924fc24-istiod-ca-cert\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.396645 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.396624    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-istio-envoy\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.396758 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.396703    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b146d379-1e46-4114-8ff5-d5406924fc24-istio-podinfo\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.406411 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.406377    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b146d379-1e46-4114-8ff5-d5406924fc24-istio-token\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.406676 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.406553    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk7xg\" (UniqueName: \"kubernetes.io/projected/b146d379-1e46-4114-8ff5-d5406924fc24-kube-api-access-tk7xg\") pod \"e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") " pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.504264 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.504167    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:28.609830 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.609780    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:28.799935 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.799875    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"]
Oct 30 21:14:28.802618 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:14:28.802581    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb146d379_1e46_4114_8ff5_d5406924fc24.slice/crio-7657490e0ef54903afb73cecb9d8abef43f3bee822949237ae2d4cdd3310696d WatchSource:0}: Error finding container 7657490e0ef54903afb73cecb9d8abef43f3bee822949237ae2d4cdd3310696d: Status 404 returned error can't find the container with id 7657490e0ef54903afb73cecb9d8abef43f3bee822949237ae2d4cdd3310696d
Oct 30 21:14:28.805226 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.805177    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:14:28.805334 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.805280    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:14:28.805334 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:28.805325    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:14:29.633046 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:29.633007    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh" event={"ID":"b146d379-1e46-4114-8ff5-d5406924fc24","Type":"ContainerStarted","Data":"8a2d12965217875cb96eacd75466a23ef4907f3af5660723133072d6b6dc44b0"}
Oct 30 21:14:29.633471 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:29.633073    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh" event={"ID":"b146d379-1e46-4114-8ff5-d5406924fc24","Type":"ContainerStarted","Data":"7657490e0ef54903afb73cecb9d8abef43f3bee822949237ae2d4cdd3310696d"}
Oct 30 21:14:30.505152 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:30.505102    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:30.510638 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:30.510614    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:30.537104 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:30.537035    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh" podStartSLOduration=2.537017271 podStartE2EDuration="2.537017271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:14:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:14:29.659434254 +0000 UTC m=+2137.478946261" watchObservedRunningTime="2026-10-30 21:14:30.537017271 +0000 UTC m=+2138.356529258"
Oct 30 21:14:30.637946 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:30.637913    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:30.639284 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:30.639263    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:31.231168 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.231135    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 21:14:31.256884 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.256840    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:14:31.274568 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.274001    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330192    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-workload-socket\") pod \"14f0cd2f-1f47-44dc-a972-e3be6850859e\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330240    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-podinfo\") pod \"14f0cd2f-1f47-44dc-a972-e3be6850859e\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330280    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f3258410-eddc-4436-bbf8-73042e516c88-kube-api-access-mzqtx\" (UniqueName: \"kubernetes.io/projected/f3258410-eddc-4436-bbf8-73042e516c88-kube-api-access-mzqtx\") pod \"f3258410-eddc-4436-bbf8-73042e516c88\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330308    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-workload-certs\") pod \"14f0cd2f-1f47-44dc-a972-e3be6850859e\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330338    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4beb25f6-a162-490a-9695-700ce6cc8d46-kube-api-access-4zzhs\" (UniqueName: \"kubernetes.io/projected/4beb25f6-a162-490a-9695-700ce6cc8d46-kube-api-access-4zzhs\") pod \"4beb25f6-a162-490a-9695-700ce6cc8d46\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330402    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f3258410-eddc-4436-bbf8-73042e516c88-istio-token\" (UniqueName: \"kubernetes.io/projected/f3258410-eddc-4436-bbf8-73042e516c88-istio-token\") pod \"f3258410-eddc-4436-bbf8-73042e516c88\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330432    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-credential-socket\") pod \"14f0cd2f-1f47-44dc-a972-e3be6850859e\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330456    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-istio-envoy\") pod \"f3258410-eddc-4436-bbf8-73042e516c88\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330489    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-podinfo\") pod \"4beb25f6-a162-490a-9695-700ce6cc8d46\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330527    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-credential-socket\") pod \"f3258410-eddc-4436-bbf8-73042e516c88\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330599    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-workload-socket\") pod \"f3258410-eddc-4436-bbf8-73042e516c88\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330637    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-token\" (UniqueName: \"kubernetes.io/projected/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-token\") pod \"14f0cd2f-1f47-44dc-a972-e3be6850859e\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330671    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-envoy\") pod \"14f0cd2f-1f47-44dc-a972-e3be6850859e\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330705    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-envoy\") pod \"4beb25f6-a162-490a-9695-700ce6cc8d46\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330752    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-data\") pod \"14f0cd2f-1f47-44dc-a972-e3be6850859e\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330790    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f3258410-eddc-4436-bbf8-73042e516c88-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3258410-eddc-4436-bbf8-73042e516c88-istio-podinfo\") pod \"f3258410-eddc-4436-bbf8-73042e516c88\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330816    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f3258410-eddc-4436-bbf8-73042e516c88-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3258410-eddc-4436-bbf8-73042e516c88-istiod-ca-cert\") pod \"f3258410-eddc-4436-bbf8-73042e516c88\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.330863    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/14f0cd2f-1f47-44dc-a972-e3be6850859e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14f0cd2f-1f47-44dc-a972-e3be6850859e-istiod-ca-cert\") pod \"14f0cd2f-1f47-44dc-a972-e3be6850859e\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.331096    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-credential-socket\") pod \"4beb25f6-a162-490a-9695-700ce6cc8d46\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.331141    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-workload-certs\") pod \"4beb25f6-a162-490a-9695-700ce6cc8d46\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.331177    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14f0cd2f-1f47-44dc-a972-e3be6850859e-kube-api-access-6zwln\" (UniqueName: \"kubernetes.io/projected/14f0cd2f-1f47-44dc-a972-e3be6850859e-kube-api-access-6zwln\") pod \"14f0cd2f-1f47-44dc-a972-e3be6850859e\" (UID: \"14f0cd2f-1f47-44dc-a972-e3be6850859e\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.331224    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4beb25f6-a162-490a-9695-700ce6cc8d46-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4beb25f6-a162-490a-9695-700ce6cc8d46-istiod-ca-cert\") pod \"4beb25f6-a162-490a-9695-700ce6cc8d46\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.331275    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-workload-socket\") pod \"4beb25f6-a162-490a-9695-700ce6cc8d46\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.331308    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-workload-certs\") pod \"f3258410-eddc-4436-bbf8-73042e516c88\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.331319    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14f0cd2f-1f47-44dc-a972-e3be6850859e-istiod-ca-cert" pod "14f0cd2f-1f47-44dc-a972-e3be6850859e" (UID: "14f0cd2f-1f47-44dc-a972-e3be6850859e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.331348    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-istio-data\") pod \"f3258410-eddc-4436-bbf8-73042e516c88\" (UID: \"f3258410-eddc-4436-bbf8-73042e516c88\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.331426    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-token\" (UniqueName: \"kubernetes.io/projected/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-token\") pod \"4beb25f6-a162-490a-9695-700ce6cc8d46\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.331431    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-credential-socket" pod "f3258410-eddc-4436-bbf8-73042e516c88" (UID: "f3258410-eddc-4436-bbf8-73042e516c88"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.331454    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-data\") pod \"4beb25f6-a162-490a-9695-700ce6cc8d46\" (UID: \"4beb25f6-a162-490a-9695-700ce6cc8d46\") "
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.331657    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-workload-certs" pod "f3258410-eddc-4436-bbf8-73042e516c88" (UID: "f3258410-eddc-4436-bbf8-73042e516c88"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.331689    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-workload-certs" pod "14f0cd2f-1f47-44dc-a972-e3be6850859e" (UID: "14f0cd2f-1f47-44dc-a972-e3be6850859e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.331703    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-workload-socket" pod "f3258410-eddc-4436-bbf8-73042e516c88" (UID: "f3258410-eddc-4436-bbf8-73042e516c88"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.331916    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-data" pod "4beb25f6-a162-490a-9695-700ce6cc8d46" (UID: "4beb25f6-a162-490a-9695-700ce6cc8d46"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.332111    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-istio-data" pod "f3258410-eddc-4436-bbf8-73042e516c88" (UID: "f3258410-eddc-4436-bbf8-73042e516c88"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.332182    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14f0cd2f-1f47-44dc-a972-e3be6850859e-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.332208    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.332227    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.332243    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.332259    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.332274    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.332506    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-data" pod "14f0cd2f-1f47-44dc-a972-e3be6850859e" (UID: "14f0cd2f-1f47-44dc-a972-e3be6850859e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.332607 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.332548    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-workload-socket" pod "14f0cd2f-1f47-44dc-a972-e3be6850859e" (UID: "14f0cd2f-1f47-44dc-a972-e3be6850859e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.336271 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.332706    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-workload-certs" pod "4beb25f6-a162-490a-9695-700ce6cc8d46" (UID: "4beb25f6-a162-490a-9695-700ce6cc8d46"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.336271 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.332719    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-credential-socket" pod "14f0cd2f-1f47-44dc-a972-e3be6850859e" (UID: "14f0cd2f-1f47-44dc-a972-e3be6850859e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.336271 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.332748    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-workload-socket" pod "4beb25f6-a162-490a-9695-700ce6cc8d46" (UID: "4beb25f6-a162-490a-9695-700ce6cc8d46"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.336271 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.333155    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3258410-eddc-4436-bbf8-73042e516c88-istiod-ca-cert" pod "f3258410-eddc-4436-bbf8-73042e516c88" (UID: "f3258410-eddc-4436-bbf8-73042e516c88"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:14:31.336271 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.333503    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4beb25f6-a162-490a-9695-700ce6cc8d46-istiod-ca-cert" pod "4beb25f6-a162-490a-9695-700ce6cc8d46" (UID: "4beb25f6-a162-490a-9695-700ce6cc8d46"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:14:31.336271 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.334040    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-credential-socket" pod "4beb25f6-a162-490a-9695-700ce6cc8d46" (UID: "4beb25f6-a162-490a-9695-700ce6cc8d46"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.336271 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.335317    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3258410-eddc-4436-bbf8-73042e516c88-istio-token" pod "f3258410-eddc-4436-bbf8-73042e516c88" (UID: "f3258410-eddc-4436-bbf8-73042e516c88"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:31.337946 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.337877    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-envoy" pod "4beb25f6-a162-490a-9695-700ce6cc8d46" (UID: "4beb25f6-a162-490a-9695-700ce6cc8d46"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.337946 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.337891    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-podinfo" pod "14f0cd2f-1f47-44dc-a972-e3be6850859e" (UID: "14f0cd2f-1f47-44dc-a972-e3be6850859e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:14:31.337946 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.337896    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-podinfo" pod "4beb25f6-a162-490a-9695-700ce6cc8d46" (UID: "4beb25f6-a162-490a-9695-700ce6cc8d46"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:14:31.338213 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.337978    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-token" pod "4beb25f6-a162-490a-9695-700ce6cc8d46" (UID: "4beb25f6-a162-490a-9695-700ce6cc8d46"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:31.338213 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.337977    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-envoy" pod "14f0cd2f-1f47-44dc-a972-e3be6850859e" (UID: "14f0cd2f-1f47-44dc-a972-e3be6850859e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.338213 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.338141    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-token" pod "14f0cd2f-1f47-44dc-a972-e3be6850859e" (UID: "14f0cd2f-1f47-44dc-a972-e3be6850859e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:31.338403 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.338313    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3258410-eddc-4436-bbf8-73042e516c88-kube-api-access-mzqtx" pod "f3258410-eddc-4436-bbf8-73042e516c88" (UID: "f3258410-eddc-4436-bbf8-73042e516c88"). InnerVolumeSpecName "kube-api-access-mzqtx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:31.338403 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.338313    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-istio-envoy" pod "f3258410-eddc-4436-bbf8-73042e516c88" (UID: "f3258410-eddc-4436-bbf8-73042e516c88"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.338528 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.338471    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14f0cd2f-1f47-44dc-a972-e3be6850859e-kube-api-access-6zwln" pod "14f0cd2f-1f47-44dc-a972-e3be6850859e" (UID: "14f0cd2f-1f47-44dc-a972-e3be6850859e"). InnerVolumeSpecName "kube-api-access-6zwln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:31.338586 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.338528    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f3258410-eddc-4436-bbf8-73042e516c88-istio-podinfo" pod "f3258410-eddc-4436-bbf8-73042e516c88" (UID: "f3258410-eddc-4436-bbf8-73042e516c88"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:14:31.339749 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.339715    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4beb25f6-a162-490a-9695-700ce6cc8d46-kube-api-access-4zzhs" pod "4beb25f6-a162-490a-9695-700ce6cc8d46" (UID: "4beb25f6-a162-490a-9695-700ce6cc8d46"). InnerVolumeSpecName "kube-api-access-4zzhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:31.433846 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433809    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4beb25f6-a162-490a-9695-700ce6cc8d46-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.433846 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433843    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.433846 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433853    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433862    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433871    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433880    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433890    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzqtx\" (UniqueName: \"kubernetes.io/projected/f3258410-eddc-4436-bbf8-73042e516c88-kube-api-access-mzqtx\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433902    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zzhs\" (UniqueName: \"kubernetes.io/projected/4beb25f6-a162-490a-9695-700ce6cc8d46-kube-api-access-4zzhs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433912    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3258410-eddc-4436-bbf8-73042e516c88-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433921    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433930    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3258410-eddc-4436-bbf8-73042e516c88-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433939    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433947    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433955    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433963    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433973    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14f0cd2f-1f47-44dc-a972-e3be6850859e-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433981    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3258410-eddc-4436-bbf8-73042e516c88-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433990    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3258410-eddc-4436-bbf8-73042e516c88-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.433998    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.434006    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4beb25f6-a162-490a-9695-700ce6cc8d46-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.434110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.434015    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zwln\" (UniqueName: \"kubernetes.io/projected/14f0cd2f-1f47-44dc-a972-e3be6850859e-kube-api-access-6zwln\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.643480 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.643439    4948 generic.go:356] "Generic (PLEG): container finished" podID="4beb25f6-a162-490a-9695-700ce6cc8d46" containerID="c29c24a3a4eb29a4a749a46015a04472d89b316cbe3f387d91526fbee61548d2" exitCode=0
Oct 30 21:14:31.643973 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.643496    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"
Oct 30 21:14:31.643973 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.643527    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9" event={"ID":"4beb25f6-a162-490a-9695-700ce6cc8d46","Type":"ContainerDied","Data":"c29c24a3a4eb29a4a749a46015a04472d89b316cbe3f387d91526fbee61548d2"}
Oct 30 21:14:31.643973 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.643587    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9" event={"ID":"4beb25f6-a162-490a-9695-700ce6cc8d46","Type":"ContainerDied","Data":"cacddbafa8d06e89dede9c15cea25f9d1c246939f4066cb21593a5e06ef042d7"}
Oct 30 21:14:31.643973 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.643618    4948 scope.go:122] "RemoveContainer" containerID="c29c24a3a4eb29a4a749a46015a04472d89b316cbe3f387d91526fbee61548d2"
Oct 30 21:14:31.645037 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.645009    4948 generic.go:356] "Generic (PLEG): container finished" podID="14f0cd2f-1f47-44dc-a972-e3be6850859e" containerID="49a923826b0a0433dcb1011eba7ff1e488dd5ff1d539ba4627854f58312e16fe" exitCode=0
Oct 30 21:14:31.645158 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.645073    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"
Oct 30 21:14:31.645158 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.645098    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z" event={"ID":"14f0cd2f-1f47-44dc-a972-e3be6850859e","Type":"ContainerDied","Data":"49a923826b0a0433dcb1011eba7ff1e488dd5ff1d539ba4627854f58312e16fe"}
Oct 30 21:14:31.645250 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.645154    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z" event={"ID":"14f0cd2f-1f47-44dc-a972-e3be6850859e","Type":"ContainerDied","Data":"d9524f00e95419c60c9fe29f1b002b4f2a5cf859573a61786fac1da7a75f814f"}
Oct 30 21:14:31.646882 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.646861    4948 generic.go:356] "Generic (PLEG): container finished" podID="f3258410-eddc-4436-bbf8-73042e516c88" containerID="e78755941921f5522c99272b195da86d01869af8720ad12284e8001f0dc2ca47" exitCode=0
Oct 30 21:14:31.647028 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.646894    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8" event={"ID":"f3258410-eddc-4436-bbf8-73042e516c88","Type":"ContainerDied","Data":"e78755941921f5522c99272b195da86d01869af8720ad12284e8001f0dc2ca47"}
Oct 30 21:14:31.647028 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.646920    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"
Oct 30 21:14:31.647028 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.646940    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8" event={"ID":"f3258410-eddc-4436-bbf8-73042e516c88","Type":"ContainerDied","Data":"7cf81f76856b41fdcf858d73e499b39d7f27c0a2aea5ba7f6390f1a1e2c6b577"}
Oct 30 21:14:31.653852 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.653826    4948 scope.go:122] "RemoveContainer" containerID="c29c24a3a4eb29a4a749a46015a04472d89b316cbe3f387d91526fbee61548d2"
Oct 30 21:14:31.654240 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:14:31.654219    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c29c24a3a4eb29a4a749a46015a04472d89b316cbe3f387d91526fbee61548d2\": container with ID starting with c29c24a3a4eb29a4a749a46015a04472d89b316cbe3f387d91526fbee61548d2 not found: ID does not exist" containerID="c29c24a3a4eb29a4a749a46015a04472d89b316cbe3f387d91526fbee61548d2"
Oct 30 21:14:31.654344 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.654250    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c29c24a3a4eb29a4a749a46015a04472d89b316cbe3f387d91526fbee61548d2"} err="failed to get container status \"c29c24a3a4eb29a4a749a46015a04472d89b316cbe3f387d91526fbee61548d2\": rpc error: code = NotFound desc = could not find container \"c29c24a3a4eb29a4a749a46015a04472d89b316cbe3f387d91526fbee61548d2\": container with ID starting with c29c24a3a4eb29a4a749a46015a04472d89b316cbe3f387d91526fbee61548d2 not found: ID does not exist"
Oct 30 21:14:31.654344 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.654269    4948 scope.go:122] "RemoveContainer" containerID="49a923826b0a0433dcb1011eba7ff1e488dd5ff1d539ba4627854f58312e16fe"
Oct 30 21:14:31.664181 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.664159    4948 scope.go:122] "RemoveContainer" containerID="49a923826b0a0433dcb1011eba7ff1e488dd5ff1d539ba4627854f58312e16fe"
Oct 30 21:14:31.664531 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:14:31.664514    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49a923826b0a0433dcb1011eba7ff1e488dd5ff1d539ba4627854f58312e16fe\": container with ID starting with 49a923826b0a0433dcb1011eba7ff1e488dd5ff1d539ba4627854f58312e16fe not found: ID does not exist" containerID="49a923826b0a0433dcb1011eba7ff1e488dd5ff1d539ba4627854f58312e16fe"
Oct 30 21:14:31.664589 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.664542    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49a923826b0a0433dcb1011eba7ff1e488dd5ff1d539ba4627854f58312e16fe"} err="failed to get container status \"49a923826b0a0433dcb1011eba7ff1e488dd5ff1d539ba4627854f58312e16fe\": rpc error: code = NotFound desc = could not find container \"49a923826b0a0433dcb1011eba7ff1e488dd5ff1d539ba4627854f58312e16fe\": container with ID starting with 49a923826b0a0433dcb1011eba7ff1e488dd5ff1d539ba4627854f58312e16fe not found: ID does not exist"
Oct 30 21:14:31.664589 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.664562    4948 scope.go:122] "RemoveContainer" containerID="e78755941921f5522c99272b195da86d01869af8720ad12284e8001f0dc2ca47"
Oct 30 21:14:31.674295 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.674255    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"]
Oct 30 21:14:31.676333 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.675484    4948 scope.go:122] "RemoveContainer" containerID="e78755941921f5522c99272b195da86d01869af8720ad12284e8001f0dc2ca47"
Oct 30 21:14:31.676624 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:14:31.676595    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e78755941921f5522c99272b195da86d01869af8720ad12284e8001f0dc2ca47\": container with ID starting with e78755941921f5522c99272b195da86d01869af8720ad12284e8001f0dc2ca47 not found: ID does not exist" containerID="e78755941921f5522c99272b195da86d01869af8720ad12284e8001f0dc2ca47"
Oct 30 21:14:31.676724 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.676639    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78755941921f5522c99272b195da86d01869af8720ad12284e8001f0dc2ca47"} err="failed to get container status \"e78755941921f5522c99272b195da86d01869af8720ad12284e8001f0dc2ca47\": rpc error: code = NotFound desc = could not find container \"e78755941921f5522c99272b195da86d01869af8720ad12284e8001f0dc2ca47\": container with ID starting with e78755941921f5522c99272b195da86d01869af8720ad12284e8001f0dc2ca47 not found: ID does not exist"
Oct 30 21:14:31.677983 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.677957    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-ls72z"]
Oct 30 21:14:31.693087 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.693047    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"]
Oct 30 21:14:31.697465 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.697417    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-qzbl9"]
Oct 30 21:14:31.713415 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.713380    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"]
Oct 30 21:14:31.717860 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:31.717825    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-g6ns8"]
Oct 30 21:14:32.106872 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:32.106819    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:32.299260 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:32.294770    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="14f0cd2f-1f47-44dc-a972-e3be6850859e" path="/var/lib/kubelet/pods/14f0cd2f-1f47-44dc-a972-e3be6850859e/volumes"
Oct 30 21:14:32.299260 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:32.295524    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4beb25f6-a162-490a-9695-700ce6cc8d46" path="/var/lib/kubelet/pods/4beb25f6-a162-490a-9695-700ce6cc8d46/volumes"
Oct 30 21:14:32.299260 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:32.296154    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f3258410-eddc-4436-bbf8-73042e516c88" path="/var/lib/kubelet/pods/f3258410-eddc-4436-bbf8-73042e516c88/volumes"
Oct 30 21:14:32.311206 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:32.311173    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:33.256262 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.256226    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"]
Oct 30 21:14:33.256723 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.256713    4948 cpu_manager.go:414] "containerMap: removing container" podUID="4beb25f6-a162-490a-9695-700ce6cc8d46" containerName="istio-proxy"
Oct 30 21:14:33.256770 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.256727    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4beb25f6-a162-490a-9695-700ce6cc8d46" containerName="istio-proxy"
Oct 30 21:14:33.256770 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.256740    4948 cpu_manager.go:414] "containerMap: removing container" podUID="14f0cd2f-1f47-44dc-a972-e3be6850859e" containerName="istio-proxy"
Oct 30 21:14:33.256770 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.256746    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="14f0cd2f-1f47-44dc-a972-e3be6850859e" containerName="istio-proxy"
Oct 30 21:14:33.256770 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.256754    4948 cpu_manager.go:414] "containerMap: removing container" podUID="f3258410-eddc-4436-bbf8-73042e516c88" containerName="istio-proxy"
Oct 30 21:14:33.256770 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.256759    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f3258410-eddc-4436-bbf8-73042e516c88" containerName="istio-proxy"
Oct 30 21:14:33.256930 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.256834    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="4beb25f6-a162-490a-9695-700ce6cc8d46" containerName="istio-proxy"
Oct 30 21:14:33.256930 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.256844    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="14f0cd2f-1f47-44dc-a972-e3be6850859e" containerName="istio-proxy"
Oct 30 21:14:33.256930 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.256850    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="f3258410-eddc-4436-bbf8-73042e516c88" containerName="istio-proxy"
Oct 30 21:14:33.261944 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.261920    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"
Oct 30 21:14:33.274132 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.274101    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-single-main-49a6a4\""
Oct 30 21:14:33.276204 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.276175    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"]
Oct 30 21:14:33.297694 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.297653    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:33.353466 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.353414    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psnz6\" (UniqueName: \"kubernetes.io/projected/63ba95a0-f120-44f2-ab47-4f1c04a4186a-kube-api-access-psnz6\") pod \"payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st\" (UID: \"63ba95a0-f120-44f2-ab47-4f1c04a4186a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"
Oct 30 21:14:33.353670 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.353491    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63ba95a0-f120-44f2-ab47-4f1c04a4186a-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st\" (UID: \"63ba95a0-f120-44f2-ab47-4f1c04a4186a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"
Oct 30 21:14:33.454691 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.454645    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psnz6\" (UniqueName: \"kubernetes.io/projected/63ba95a0-f120-44f2-ab47-4f1c04a4186a-kube-api-access-psnz6\") pod \"payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st\" (UID: \"63ba95a0-f120-44f2-ab47-4f1c04a4186a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"
Oct 30 21:14:33.454691 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.454697    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63ba95a0-f120-44f2-ab47-4f1c04a4186a-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st\" (UID: \"63ba95a0-f120-44f2-ab47-4f1c04a4186a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"
Oct 30 21:14:33.455505 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.455483    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63ba95a0-f120-44f2-ab47-4f1c04a4186a-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st\" (UID: \"63ba95a0-f120-44f2-ab47-4f1c04a4186a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"
Oct 30 21:14:33.467279 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.467241    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psnz6\" (UniqueName: \"kubernetes.io/projected/63ba95a0-f120-44f2-ab47-4f1c04a4186a-kube-api-access-psnz6\") pod \"payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st\" (UID: \"63ba95a0-f120-44f2-ab47-4f1c04a4186a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"
Oct 30 21:14:33.511689 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.511591    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:33.576913 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.576874    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"
Oct 30 21:14:33.859599 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:33.859571    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"]
Oct 30 21:14:33.862826 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:14:33.862788    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63ba95a0_f120_44f2_ab47_4f1c04a4186a.slice/crio-9995d0d45531ed999bbf9eb7831e79b0d5f895584a8f6533d376c7bd87dca8a1 WatchSource:0}: Error finding container 9995d0d45531ed999bbf9eb7831e79b0d5f895584a8f6533d376c7bd87dca8a1: Status 404 returned error can't find the container with id 9995d0d45531ed999bbf9eb7831e79b0d5f895584a8f6533d376c7bd87dca8a1
Oct 30 21:14:34.191733 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:34.191640    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:34.668225 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:34.668185    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st" event={"ID":"63ba95a0-f120-44f2-ab47-4f1c04a4186a","Type":"ContainerStarted","Data":"b9210556f09e5443139b5a3987d04ef3b998c21b64135bb9f610682ca19dcc33"}
Oct 30 21:14:34.668821 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:34.668251    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st" event={"ID":"63ba95a0-f120-44f2-ab47-4f1c04a4186a","Type":"ContainerStarted","Data":"9995d0d45531ed999bbf9eb7831e79b0d5f895584a8f6533d376c7bd87dca8a1"}
Oct 30 21:14:34.668821 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:34.668384    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"
Oct 30 21:14:34.686527 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:34.686468    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st" podStartSLOduration=1.68645356 podStartE2EDuration="1.68645356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:14:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:14:34.685509013 +0000 UTC m=+2142.505021003" watchObservedRunningTime="2026-10-30 21:14:34.68645356 +0000 UTC m=+2142.505965559"
Oct 30 21:14:34.981782 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:34.981682    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:35.702707 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:35.702666    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:36.496289 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:36.496252    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:37.308548 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:37.308508    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:38.115277 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:38.115237    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:38.869387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:38.868464    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:39.616513 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:39.616473    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:40.387891 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:40.387841    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:41.291314 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:41.291277    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:42.318788 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:42.318747    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:43.182682 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:43.182643    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:44.001786 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:44.001743    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:44.696856 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:44.696812    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:44.965300 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:44.965172    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:45.406135 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:45.406096    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:45.639647 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:45.639603    4948 patch_prober.go:29] interesting pod/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:14:45.639918 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:45.639671    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh" podUID="b146d379-1e46-4114-8ff5-d5406924fc24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 21:14:45.677122 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:45.677027    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"
Oct 30 21:14:45.732915 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:45.732819    4948 generic.go:356] "Generic (PLEG): container finished" podID="b146d379-1e46-4114-8ff5-d5406924fc24" containerID="8a2d12965217875cb96eacd75466a23ef4907f3af5660723133072d6b6dc44b0" exitCode=0
Oct 30 21:14:45.732915 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:45.732870    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh" event={"ID":"b146d379-1e46-4114-8ff5-d5406924fc24","Type":"ContainerDied","Data":"8a2d12965217875cb96eacd75466a23ef4907f3af5660723133072d6b6dc44b0"}
Oct 30 21:14:45.733343 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:45.733308    4948 scope.go:122] "RemoveContainer" containerID="8a2d12965217875cb96eacd75466a23ef4907f3af5660723133072d6b6dc44b0"
Oct 30 21:14:45.734651 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:45.734621    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:14:45.734743 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:45.734698    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:14:45.734743 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:45.734734    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:14:46.172387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:46.171460    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:46.740192 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:46.740152    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh" event={"ID":"b146d379-1e46-4114-8ff5-d5406924fc24","Type":"ContainerStarted","Data":"33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469"}
Oct 30 21:14:46.994937 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:46.994827    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:47.204230 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:47.204173    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:47.504460 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:47.504416    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:47.504669 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:47.504644    4948 patch_prober.go:29] interesting pod/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:14:47.504744 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:47.504719    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh" podUID="b146d379-1e46-4114-8ff5-d5406924fc24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 21:14:48.505434 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:48.505392    4948 patch_prober.go:29] interesting pod/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:14:48.505880 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:48.505450    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh" podUID="b146d379-1e46-4114-8ff5-d5406924fc24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 21:14:48.577466 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:48.577426    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:48.781479 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:48.781337    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:48.981437 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:48.981402    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:49.504830 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:49.504784    4948 patch_prober.go:29] interesting pod/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:14:49.505026 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:49.504855    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh" podUID="b146d379-1e46-4114-8ff5-d5406924fc24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 21:14:49.619171 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:49.619126    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:50.505462 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:50.505416    4948 patch_prober.go:29] interesting pod/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:14:50.505676 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:50.505494    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh" podUID="b146d379-1e46-4114-8ff5-d5406924fc24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 21:14:50.548149 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:50.548105    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:51.505324 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:51.505279    4948 patch_prober.go:29] interesting pod/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:14:51.505791 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:51.505344    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh" podUID="b146d379-1e46-4114-8ff5-d5406924fc24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 21:14:51.522079 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:51.522043    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:52.312330 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:52.312285    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:52.510407 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:52.510352    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:52.510852 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:52.510830    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:52.511669 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:52.511648    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:14:53.202224 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:53.202182    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:53.932225 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:14:53.932189    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:14:53.966236 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:53.966199    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:54.693773 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:54.693723    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:55.393258 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:55.393219    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:55.985578 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:55.985537    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"]
Oct 30 21:14:55.990642 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:55.990613    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:55.995673 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:55.995641    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6qg5v\""
Oct 30 21:14:56.004905 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.004862    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"]
Oct 30 21:14:56.008058 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.008023    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"]
Oct 30 21:14:56.012031 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.012001    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.022233 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.022172    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"]
Oct 30 21:14:56.094570 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.094531    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng669\" (UniqueName: \"kubernetes.io/projected/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-kube-api-access-ng669\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.094570 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.094577    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gddc\" (UniqueName: \"kubernetes.io/projected/c43e679e-4441-4d13-b292-f52e9156418b-kube-api-access-8gddc\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.094815 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.094667    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.094815 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.094710    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c43e679e-4441-4d13-b292-f52e9156418b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.094815 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.094773    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.094815 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.094790    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c43e679e-4441-4d13-b292-f52e9156418b-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.094965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.094846    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c43e679e-4441-4d13-b292-f52e9156418b-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.094965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.094885    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.094965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.094907    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c43e679e-4441-4d13-b292-f52e9156418b-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.094965 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.094926    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c43e679e-4441-4d13-b292-f52e9156418b-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.095107 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.095014    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c43e679e-4441-4d13-b292-f52e9156418b-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.095107 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.095051    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c43e679e-4441-4d13-b292-f52e9156418b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.095107 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.095070    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.095226 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.095109    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.095226 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.095145    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.095226 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.095189    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c43e679e-4441-4d13-b292-f52e9156418b-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.095226 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.095220    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.095403 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.095241    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.106845 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.106809    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:56.196725 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.196677    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.196725 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.196724    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c43e679e-4441-4d13-b292-f52e9156418b-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.197022 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.196749    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c43e679e-4441-4d13-b292-f52e9156418b-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.197022 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.196777    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c43e679e-4441-4d13-b292-f52e9156418b-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.197022 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.196805    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c43e679e-4441-4d13-b292-f52e9156418b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.197022 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.196821    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.197022 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.196850    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.197022 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.196988    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.197337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.197046    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c43e679e-4441-4d13-b292-f52e9156418b-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.197337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.197083    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.197337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.197112    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.197337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.197174    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng669\" (UniqueName: \"kubernetes.io/projected/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-kube-api-access-ng669\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.197337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.197216    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c43e679e-4441-4d13-b292-f52e9156418b-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.197337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.197214    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gddc\" (UniqueName: \"kubernetes.io/projected/c43e679e-4441-4d13-b292-f52e9156418b-kube-api-access-8gddc\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.197337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.197252    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c43e679e-4441-4d13-b292-f52e9156418b-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.197337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.197257    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.197337 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.197272    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.197834 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.197337    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.197834 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.197430    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c43e679e-4441-4d13-b292-f52e9156418b-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.197834 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.197590    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c43e679e-4441-4d13-b292-f52e9156418b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.197834 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.197648    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.197834 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.197657    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.197834 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.197700    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c43e679e-4441-4d13-b292-f52e9156418b-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.197834 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.197747    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c43e679e-4441-4d13-b292-f52e9156418b-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.198207 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.197901    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.198207 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.198048    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.198207 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.198070    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c43e679e-4441-4d13-b292-f52e9156418b-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.198550 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.198530    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c43e679e-4441-4d13-b292-f52e9156418b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.199982 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.199953    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.200096 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.199960    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.200142 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.200127    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c43e679e-4441-4d13-b292-f52e9156418b-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.200188 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.200165    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c43e679e-4441-4d13-b292-f52e9156418b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.215333 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.215300    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c43e679e-4441-4d13-b292-f52e9156418b-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.215520 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.215305    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.215721 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.215702    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gddc\" (UniqueName: \"kubernetes.io/projected/c43e679e-4441-4d13-b292-f52e9156418b-kube-api-access-8gddc\") pod \"maas-default-gateway-openshift-default-58c6585447-hjllt\" (UID: \"c43e679e-4441-4d13-b292-f52e9156418b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.215848 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.215827    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng669\" (UniqueName: \"kubernetes.io/projected/d6d65231-7d0f-4f6a-ac10-e51e952ba70e-kube-api-access-ng669\") pod \"maas-default-gateway-openshift-default-58c6585447-2sd5b\" (UID: \"d6d65231-7d0f-4f6a-ac10-e51e952ba70e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.306516 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.306410    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:56.332289 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.332235    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:56.598113 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.598084    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"]
Oct 30 21:14:56.600056 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:14:56.600023    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc43e679e_4441_4d13_b292_f52e9156418b.slice/crio-60dcf0d632dfded765b539c7d4544e012e0aa4b01f3866cebd15b0f9902ac668 WatchSource:0}: Error finding container 60dcf0d632dfded765b539c7d4544e012e0aa4b01f3866cebd15b0f9902ac668: Status 404 returned error can't find the container with id 60dcf0d632dfded765b539c7d4544e012e0aa4b01f3866cebd15b0f9902ac668
Oct 30 21:14:56.602592 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.602556    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:14:56.602689 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.602626    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:14:56.602689 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.602659    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:14:56.634847 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.634818    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"]
Oct 30 21:14:56.636795 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:14:56.636758    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d65231_7d0f_4f6a_ac10_e51e952ba70e.slice/crio-f76b7a0aac4e260646b3b319c9d20f3ec397177c21be73d134bbff237191a96a WatchSource:0}: Error finding container f76b7a0aac4e260646b3b319c9d20f3ec397177c21be73d134bbff237191a96a: Status 404 returned error can't find the container with id f76b7a0aac4e260646b3b319c9d20f3ec397177c21be73d134bbff237191a96a
Oct 30 21:14:56.639460 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.639414    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:14:56.639622 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.639515    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:14:56.639622 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.639556    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:14:56.801724 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.801674    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:56.818512 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.817650    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b" event={"ID":"d6d65231-7d0f-4f6a-ac10-e51e952ba70e","Type":"ContainerStarted","Data":"bfdb2c1d4484cd4df67a2830f3a73e1bee7e399951844ed631a05c57dccdbba0"}
Oct 30 21:14:56.818512 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.817707    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b" event={"ID":"d6d65231-7d0f-4f6a-ac10-e51e952ba70e","Type":"ContainerStarted","Data":"f76b7a0aac4e260646b3b319c9d20f3ec397177c21be73d134bbff237191a96a"}
Oct 30 21:14:56.820743 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.820710    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt" event={"ID":"c43e679e-4441-4d13-b292-f52e9156418b","Type":"ContainerStarted","Data":"fbf5a7062060e3d51a13c05fab3d6ebac07f0b6338146916e2f93e26d609b02b"}
Oct 30 21:14:56.820943 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.820772    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt" event={"ID":"c43e679e-4441-4d13-b292-f52e9156418b","Type":"ContainerStarted","Data":"60dcf0d632dfded765b539c7d4544e012e0aa4b01f3866cebd15b0f9902ac668"}
Oct 30 21:14:56.845164 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.845101    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b" podStartSLOduration=1.845083722 podStartE2EDuration="1.845083722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:14:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:14:56.84317786 +0000 UTC m=+2164.662689851" watchObservedRunningTime="2026-10-30 21:14:56.845083722 +0000 UTC m=+2164.664595809"
Oct 30 21:14:56.869794 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:56.869642    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt" podStartSLOduration=1.869618037 podStartE2EDuration="1.869618037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:14:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:14:56.867030059 +0000 UTC m=+2164.686542072" watchObservedRunningTime="2026-10-30 21:14:56.869618037 +0000 UTC m=+2164.689130027"
Oct 30 21:14:57.307038 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:57.306922    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:14:57.308570 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:57.308533    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-hjllt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:14:57.308737 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:57.308599    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt" podUID="c43e679e-4441-4d13-b292-f52e9156418b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:14:57.332993 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:57.332948    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:14:57.334468 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:57.334441    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-2sd5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:14:57.334584 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:57.334488    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b" podUID="d6d65231-7d0f-4f6a-ac10-e51e952ba70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:14:57.814297 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:57.814258    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:58.306997 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:58.306960    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-hjllt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:14:58.307224 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:58.307032    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt" podUID="c43e679e-4441-4d13-b292-f52e9156418b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:14:58.332992 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:58.332951    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-2sd5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:14:58.333152 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:58.333019    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b" podUID="d6d65231-7d0f-4f6a-ac10-e51e952ba70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:14:58.669387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:58.668511    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:14:59.310398 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:59.310004    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-hjllt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:14:59.310398 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:59.310104    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt" podUID="c43e679e-4441-4d13-b292-f52e9156418b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:14:59.333035 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:59.332995    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-2sd5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:14:59.333227 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:59.333061    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b" podUID="d6d65231-7d0f-4f6a-ac10-e51e952ba70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:14:59.570454 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:14:59.569686    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:00.143891 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:00.143848    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5"]
Oct 30 21:15:00.148003 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:00.147973    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5"
Oct 30 21:15:00.164404 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:00.156995    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5"]
Oct 30 21:15:00.165665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:00.165637    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:15:00.245879 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:00.245833    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnxzh\" (UniqueName: \"kubernetes.io/projected/b1e40274-2332-48f9-acfd-f3f1428a7af3-kube-api-access-cnxzh\") pod \"maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5\" (UID: \"b1e40274-2332-48f9-acfd-f3f1428a7af3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5"
Oct 30 21:15:00.246093 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:00.245888    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e40274-2332-48f9-acfd-f3f1428a7af3-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5\" (UID: \"b1e40274-2332-48f9-acfd-f3f1428a7af3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5"
Oct 30 21:15:00.307052 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:00.307009    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-hjllt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:15:00.307247 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:00.307062    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt" podUID="c43e679e-4441-4d13-b292-f52e9156418b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:15:00.333270 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:00.333233    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-2sd5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:15:00.333830 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:00.333798    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b" podUID="d6d65231-7d0f-4f6a-ac10-e51e952ba70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:15:00.347459 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:00.347424    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnxzh\" (UniqueName: \"kubernetes.io/projected/b1e40274-2332-48f9-acfd-f3f1428a7af3-kube-api-access-cnxzh\") pod \"maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5\" (UID: \"b1e40274-2332-48f9-acfd-f3f1428a7af3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5"
Oct 30 21:15:00.347691 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:00.347472    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e40274-2332-48f9-acfd-f3f1428a7af3-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5\" (UID: \"b1e40274-2332-48f9-acfd-f3f1428a7af3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5"
Oct 30 21:15:00.348422 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:00.348398    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e40274-2332-48f9-acfd-f3f1428a7af3-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5\" (UID: \"b1e40274-2332-48f9-acfd-f3f1428a7af3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5"
Oct 30 21:15:00.368400 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:00.365760    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnxzh\" (UniqueName: \"kubernetes.io/projected/b1e40274-2332-48f9-acfd-f3f1428a7af3-kube-api-access-cnxzh\") pod \"maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5\" (UID: \"b1e40274-2332-48f9-acfd-f3f1428a7af3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5"
Oct 30 21:15:00.518433 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:00.518279    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5"
Oct 30 21:15:00.562389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:00.559973    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:00.844945 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:00.844913    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5"]
Oct 30 21:15:00.847637 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:15:00.847603    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e40274_2332_48f9_acfd_f3f1428a7af3.slice/crio-2960ea0ff72b7998af25150bfc87b762b3e40e0d1cafa00d76924690fd53f0a4 WatchSource:0}: Error finding container 2960ea0ff72b7998af25150bfc87b762b3e40e0d1cafa00d76924690fd53f0a4: Status 404 returned error can't find the container with id 2960ea0ff72b7998af25150bfc87b762b3e40e0d1cafa00d76924690fd53f0a4
Oct 30 21:15:01.308029 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:01.307986    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-hjllt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:15:01.308240 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:01.308062    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt" podUID="c43e679e-4441-4d13-b292-f52e9156418b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:15:01.332967 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:01.332928    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-2sd5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:15:01.333225 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:01.333202    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b" podUID="d6d65231-7d0f-4f6a-ac10-e51e952ba70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:15:01.471835 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:01.471574    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:01.862339 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:01.862276    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5" event={"ID":"b1e40274-2332-48f9-acfd-f3f1428a7af3","Type":"ContainerStarted","Data":"2382fd9dd0ec87f7c437adee977b14b3992838f6d79290bd0c3279c0cf5d28d7"}
Oct 30 21:15:01.862710 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:01.862683    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5" event={"ID":"b1e40274-2332-48f9-acfd-f3f1428a7af3","Type":"ContainerStarted","Data":"2960ea0ff72b7998af25150bfc87b762b3e40e0d1cafa00d76924690fd53f0a4"}
Oct 30 21:15:01.904397 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:01.903798    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5" podStartSLOduration=1.90377352 podStartE2EDuration="1.90377352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:15:01.901810619 +0000 UTC m=+2169.721322609" watchObservedRunningTime="2026-10-30 21:15:01.90377352 +0000 UTC m=+2169.723285511"
Oct 30 21:15:02.306879 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:02.306841    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-hjllt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:15:02.307079 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:02.306902    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt" podUID="c43e679e-4441-4d13-b292-f52e9156418b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:15:02.333232 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:02.333191    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-2sd5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:15:02.333481 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:02.333249    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b" podUID="d6d65231-7d0f-4f6a-ac10-e51e952ba70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:15:02.403861 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:02.403708    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:02.870754 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:02.870703    4948 generic.go:356] "Generic (PLEG): container finished" podID="b1e40274-2332-48f9-acfd-f3f1428a7af3" containerID="2382fd9dd0ec87f7c437adee977b14b3992838f6d79290bd0c3279c0cf5d28d7" exitCode=60
Oct 30 21:15:02.871240 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:02.870860    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5" event={"ID":"b1e40274-2332-48f9-acfd-f3f1428a7af3","Type":"ContainerDied","Data":"2382fd9dd0ec87f7c437adee977b14b3992838f6d79290bd0c3279c0cf5d28d7"}
Oct 30 21:15:02.871240 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:02.871099    4948 scope.go:122] "RemoveContainer" containerID="2382fd9dd0ec87f7c437adee977b14b3992838f6d79290bd0c3279c0cf5d28d7"
Oct 30 21:15:03.307812 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:03.307768    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-hjllt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:15:03.308018 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:03.307841    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt" podUID="c43e679e-4441-4d13-b292-f52e9156418b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:15:03.332849 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:03.332806    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-2sd5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:15:03.333044 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:03.332895    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b" podUID="d6d65231-7d0f-4f6a-ac10-e51e952ba70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:15:03.445034 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:03.444911    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:03.880792 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:03.880744    4948 generic.go:356] "Generic (PLEG): container finished" podID="b1e40274-2332-48f9-acfd-f3f1428a7af3" containerID="4f5741a8a7eab15f99e1038b293a604f20e699a898cb990c95e1b91a6996099b" exitCode=60
Oct 30 21:15:03.881336 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:03.880800    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5" event={"ID":"b1e40274-2332-48f9-acfd-f3f1428a7af3","Type":"ContainerDied","Data":"4f5741a8a7eab15f99e1038b293a604f20e699a898cb990c95e1b91a6996099b"}
Oct 30 21:15:03.881336 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:03.880869    4948 scope.go:122] "RemoveContainer" containerID="2382fd9dd0ec87f7c437adee977b14b3992838f6d79290bd0c3279c0cf5d28d7"
Oct 30 21:15:03.881336 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:03.881131    4948 scope.go:122] "RemoveContainer" containerID="4f5741a8a7eab15f99e1038b293a604f20e699a898cb990c95e1b91a6996099b"
Oct 30 21:15:03.881545 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:15:03.881487    4948 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5_odh-ai-gateway-infra(b1e40274-2332-48f9-acfd-f3f1428a7af3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5" podUID="b1e40274-2332-48f9-acfd-f3f1428a7af3"
Oct 30 21:15:04.191971 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:04.191873    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:04.307819 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:04.307784    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-hjllt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:15:04.308017 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:04.307841    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt" podUID="c43e679e-4441-4d13-b292-f52e9156418b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:15:04.333694 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:04.333642    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-2sd5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:15:04.333925 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:04.333711    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b" podUID="d6d65231-7d0f-4f6a-ac10-e51e952ba70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:15:04.892304 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:04.892262    4948 scope.go:122] "RemoveContainer" containerID="4f5741a8a7eab15f99e1038b293a604f20e699a898cb990c95e1b91a6996099b"
Oct 30 21:15:04.892887 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:15:04.892644    4948 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5_odh-ai-gateway-infra(b1e40274-2332-48f9-acfd-f3f1428a7af3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5" podUID="b1e40274-2332-48f9-acfd-f3f1428a7af3"
Oct 30 21:15:05.084239 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:05.084201    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:05.496644 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:05.496605    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:15:05.497476 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:05.497431    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:15:05.498284 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:05.498264    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-2sd5b"
Oct 30 21:15:05.556411 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:05.556380    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:15:05.558639 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:05.558611    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:15:05.562308 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:05.562278    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-hjllt"
Oct 30 21:15:05.897636 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:05.897599    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:06.617917 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:06.617877    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:07.487499 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:07.487455    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:08.205701 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:08.205665    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:08.894243 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:08.894203    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:09.592535 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:09.592497    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:10.290008 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:10.289965    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:10.998556 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:10.998512    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:11.687962 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:11.687922    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:12.389074 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:12.389037    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:13.117789 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:13.117751    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:13.885288 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:13.885227    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:14.591298 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:14.591230    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:15.312726 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:15.312672    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:16.099825 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:16.099782    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:16.786514 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:16.786433    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:17.494435 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:17.494399    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:18.201069 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:18.201016    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:18.286977 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:18.286943    4948 scope.go:122] "RemoveContainer" containerID="4f5741a8a7eab15f99e1038b293a604f20e699a898cb990c95e1b91a6996099b"
Oct 30 21:15:18.900940 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:18.900904    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:18.969163 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:18.969125    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5" event={"ID":"b1e40274-2332-48f9-acfd-f3f1428a7af3","Type":"ContainerStarted","Data":"70f509a1116bf34c54b623247593995376557668004757250577ee5b91a5455b"}
Oct 30 21:15:19.602936 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:19.602880    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:19.976758 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:19.976719    4948 generic.go:356] "Generic (PLEG): container finished" podID="b1e40274-2332-48f9-acfd-f3f1428a7af3" containerID="70f509a1116bf34c54b623247593995376557668004757250577ee5b91a5455b" exitCode=60
Oct 30 21:15:19.977277 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:19.976784    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5" event={"ID":"b1e40274-2332-48f9-acfd-f3f1428a7af3","Type":"ContainerDied","Data":"70f509a1116bf34c54b623247593995376557668004757250577ee5b91a5455b"}
Oct 30 21:15:19.977277 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:19.976850    4948 scope.go:122] "RemoveContainer" containerID="4f5741a8a7eab15f99e1038b293a604f20e699a898cb990c95e1b91a6996099b"
Oct 30 21:15:19.977277 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:19.977236    4948 scope.go:122] "RemoveContainer" containerID="70f509a1116bf34c54b623247593995376557668004757250577ee5b91a5455b"
Oct 30 21:15:19.977577 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:15:19.977553    4948 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5_odh-ai-gateway-infra(b1e40274-2332-48f9-acfd-f3f1428a7af3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5" podUID="b1e40274-2332-48f9-acfd-f3f1428a7af3"
Oct 30 21:15:20.006350 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:20.006304    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5"]
Oct 30 21:15:20.345877 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:20.345838    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:21.142496 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:21.142458    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5"
Oct 30 21:15:21.182624 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:21.182591    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:21.237329 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:21.237235    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b1e40274-2332-48f9-acfd-f3f1428a7af3-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e40274-2332-48f9-acfd-f3f1428a7af3-maas-api-service-ca\") pod \"b1e40274-2332-48f9-acfd-f3f1428a7af3\" (UID: \"b1e40274-2332-48f9-acfd-f3f1428a7af3\") "
Oct 30 21:15:21.237329 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:21.237285    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b1e40274-2332-48f9-acfd-f3f1428a7af3-kube-api-access-cnxzh\" (UniqueName: \"kubernetes.io/projected/b1e40274-2332-48f9-acfd-f3f1428a7af3-kube-api-access-cnxzh\") pod \"b1e40274-2332-48f9-acfd-f3f1428a7af3\" (UID: \"b1e40274-2332-48f9-acfd-f3f1428a7af3\") "
Oct 30 21:15:21.237735 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:21.237706    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e40274-2332-48f9-acfd-f3f1428a7af3-maas-api-service-ca" pod "b1e40274-2332-48f9-acfd-f3f1428a7af3" (UID: "b1e40274-2332-48f9-acfd-f3f1428a7af3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:15:21.239571 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:21.239539    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1e40274-2332-48f9-acfd-f3f1428a7af3-kube-api-access-cnxzh" pod "b1e40274-2332-48f9-acfd-f3f1428a7af3" (UID: "b1e40274-2332-48f9-acfd-f3f1428a7af3"). InnerVolumeSpecName "kube-api-access-cnxzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:21.338771 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:21.338735    4948 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e40274-2332-48f9-acfd-f3f1428a7af3-maas-api-service-ca\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:21.338771 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:21.338765    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnxzh\" (UniqueName: \"kubernetes.io/projected/b1e40274-2332-48f9-acfd-f3f1428a7af3-kube-api-access-cnxzh\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:21.990198 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:21.990165    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5"
Oct 30 21:15:21.990412 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:21.990195    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5" event={"ID":"b1e40274-2332-48f9-acfd-f3f1428a7af3","Type":"ContainerDied","Data":"2960ea0ff72b7998af25150bfc87b762b3e40e0d1cafa00d76924690fd53f0a4"}
Oct 30 21:15:21.990412 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:21.990259    4948 scope.go:122] "RemoveContainer" containerID="70f509a1116bf34c54b623247593995376557668004757250577ee5b91a5455b"
Oct 30 21:15:21.992732 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:21.992684    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:22.015813 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:22.015773    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5"]
Oct 30 21:15:22.025943 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:22.025907    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-single-main-49a6a4-29889915frq5"]
Oct 30 21:15:22.293268 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:22.293180    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b1e40274-2332-48f9-acfd-f3f1428a7af3" path="/var/lib/kubelet/pods/b1e40274-2332-48f9-acfd-f3f1428a7af3/volumes"
Oct 30 21:15:22.803276 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:22.803231    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:23.494576 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:23.494530    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:23.930106 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:15:23.930065    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:15:24.197477 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:24.197333    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:24.902783 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:24.902733    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:25.604577 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:25.604537    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:26.294506 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:26.294464    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:27.112979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:27.112937    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:27.795040 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:27.795002    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:28.489866 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:28.489826    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:29.192536 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:29.192492    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:29.865478 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:29.865436    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:30.063256 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:30.063187    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:30.891832 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:30.891790    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:31.781334 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:31.781298    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:32.600204 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:32.600168    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:33.367054 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:33.367013    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:34.091851 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:34.091814    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:34.814766 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:34.814725    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:35.024558 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:35.024524    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:35.553333 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:35.553296    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:36.191300 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:36.191260    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:36.998176 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:36.998138    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:37.688954 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:37.688914    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:38.388825 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:38.388790    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:39.086606 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:39.086563    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:39.789804 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:39.789761    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:39.972700 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:39.972649    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"]
Oct 30 21:15:40.139742 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:40.139697    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:40.341019 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:40.340969    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:40.540926 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:40.540820    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:40.746804 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:40.746756    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:41.090478 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:41.090445    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:44.888703 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:44.888647    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:44.973381 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:44.973306    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st" podUID="63ba95a0-f120-44f2-ab47-4f1c04a4186a" containerName="payload-pre-processing" containerID="cri-o://b9210556f09e5443139b5a3987d04ef3b998c21b64135bb9f610682ca19dcc33" gracePeriod=25
Oct 30 21:15:45.099457 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:45.099416    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:45.675318 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:45.675273    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st" podUID="63ba95a0-f120-44f2-ab47-4f1c04a4186a" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:15:47.123868 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:47.123820    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:47.346507 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:47.346466    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"]
Oct 30 21:15:47.346759 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:47.346734    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh" podUID="b146d379-1e46-4114-8ff5-d5406924fc24" containerName="istio-proxy" containerID="cri-o://33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469" gracePeriod=30
Oct 30 21:15:47.350150 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:47.350100    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:47.555325 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:47.555232    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:15:52.513041 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.512991    4948 patch_prober.go:29] interesting pod/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:15:52.513575 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.513080    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh" podUID="b146d379-1e46-4114-8ff5-d5406924fc24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 21:15:52.612606 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.612528    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:15:52.679935 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.679898    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-credential-socket\") pod \"b146d379-1e46-4114-8ff5-d5406924fc24\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") "
Oct 30 21:15:52.680157 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.679945    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b146d379-1e46-4114-8ff5-d5406924fc24-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b146d379-1e46-4114-8ff5-d5406924fc24-istio-podinfo\") pod \"b146d379-1e46-4114-8ff5-d5406924fc24\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") "
Oct 30 21:15:52.680157 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.679968    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b146d379-1e46-4114-8ff5-d5406924fc24-istio-token\" (UniqueName: \"kubernetes.io/projected/b146d379-1e46-4114-8ff5-d5406924fc24-istio-token\") pod \"b146d379-1e46-4114-8ff5-d5406924fc24\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") "
Oct 30 21:15:52.680157 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.679994    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-workload-socket\") pod \"b146d379-1e46-4114-8ff5-d5406924fc24\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") "
Oct 30 21:15:52.680157 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.680059    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-istio-data\") pod \"b146d379-1e46-4114-8ff5-d5406924fc24\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") "
Oct 30 21:15:52.680157 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.680108    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-istio-envoy\") pod \"b146d379-1e46-4114-8ff5-d5406924fc24\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") "
Oct 30 21:15:52.680157 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.680156    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b146d379-1e46-4114-8ff5-d5406924fc24-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b146d379-1e46-4114-8ff5-d5406924fc24-istiod-ca-cert\") pod \"b146d379-1e46-4114-8ff5-d5406924fc24\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") "
Oct 30 21:15:52.680438 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.680207    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-workload-certs\") pod \"b146d379-1e46-4114-8ff5-d5406924fc24\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") "
Oct 30 21:15:52.680438 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.680247    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b146d379-1e46-4114-8ff5-d5406924fc24-kube-api-access-tk7xg\" (UniqueName: \"kubernetes.io/projected/b146d379-1e46-4114-8ff5-d5406924fc24-kube-api-access-tk7xg\") pod \"b146d379-1e46-4114-8ff5-d5406924fc24\" (UID: \"b146d379-1e46-4114-8ff5-d5406924fc24\") "
Oct 30 21:15:52.680438 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.680271    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-credential-socket" pod "b146d379-1e46-4114-8ff5-d5406924fc24" (UID: "b146d379-1e46-4114-8ff5-d5406924fc24"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:52.680612 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.680584    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-workload-socket" pod "b146d379-1e46-4114-8ff5-d5406924fc24" (UID: "b146d379-1e46-4114-8ff5-d5406924fc24"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:52.680836 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.680642    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-istio-data" pod "b146d379-1e46-4114-8ff5-d5406924fc24" (UID: "b146d379-1e46-4114-8ff5-d5406924fc24"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:52.680955 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.680720    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:52.680955 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.680862    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-workload-certs" pod "b146d379-1e46-4114-8ff5-d5406924fc24" (UID: "b146d379-1e46-4114-8ff5-d5406924fc24"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:52.681127 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.681039    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b146d379-1e46-4114-8ff5-d5406924fc24-istiod-ca-cert" pod "b146d379-1e46-4114-8ff5-d5406924fc24" (UID: "b146d379-1e46-4114-8ff5-d5406924fc24"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:15:52.682716 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.682687    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b146d379-1e46-4114-8ff5-d5406924fc24-istio-podinfo" pod "b146d379-1e46-4114-8ff5-d5406924fc24" (UID: "b146d379-1e46-4114-8ff5-d5406924fc24"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:15:52.682839 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.682813    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b146d379-1e46-4114-8ff5-d5406924fc24-istio-token" pod "b146d379-1e46-4114-8ff5-d5406924fc24" (UID: "b146d379-1e46-4114-8ff5-d5406924fc24"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:52.682901 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.682887    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-istio-envoy" pod "b146d379-1e46-4114-8ff5-d5406924fc24" (UID: "b146d379-1e46-4114-8ff5-d5406924fc24"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:15:52.683077 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.683055    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b146d379-1e46-4114-8ff5-d5406924fc24-kube-api-access-tk7xg" pod "b146d379-1e46-4114-8ff5-d5406924fc24" (UID: "b146d379-1e46-4114-8ff5-d5406924fc24"). InnerVolumeSpecName "kube-api-access-tk7xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:52.782539 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.782489    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:52.782539 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.782527    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk7xg\" (UniqueName: \"kubernetes.io/projected/b146d379-1e46-4114-8ff5-d5406924fc24-kube-api-access-tk7xg\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:52.782539 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.782543    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b146d379-1e46-4114-8ff5-d5406924fc24-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:52.782813 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.782557    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b146d379-1e46-4114-8ff5-d5406924fc24-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:52.782813 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.782568    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:52.782813 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.782577    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:52.782813 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.782585    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b146d379-1e46-4114-8ff5-d5406924fc24-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:52.782813 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:52.782594    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b146d379-1e46-4114-8ff5-d5406924fc24-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:53.161307 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:53.161264    4948 generic.go:356] "Generic (PLEG): container finished" podID="b146d379-1e46-4114-8ff5-d5406924fc24" containerID="33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469" exitCode=0
Oct 30 21:15:53.161530 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:53.161327    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"
Oct 30 21:15:53.161530 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:53.161354    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh" event={"ID":"b146d379-1e46-4114-8ff5-d5406924fc24","Type":"ContainerDied","Data":"33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469"}
Oct 30 21:15:53.161530 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:53.161443    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh" event={"ID":"b146d379-1e46-4114-8ff5-d5406924fc24","Type":"ContainerDied","Data":"7657490e0ef54903afb73cecb9d8abef43f3bee822949237ae2d4cdd3310696d"}
Oct 30 21:15:53.161530 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:53.161467    4948 scope.go:122] "RemoveContainer" containerID="33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469"
Oct 30 21:15:53.171309 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:53.171289    4948 scope.go:122] "RemoveContainer" containerID="8a2d12965217875cb96eacd75466a23ef4907f3af5660723133072d6b6dc44b0"
Oct 30 21:15:53.181640 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:53.181613    4948 scope.go:122] "RemoveContainer" containerID="33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469"
Oct 30 21:15:53.181985 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:15:53.181964    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469\": container with ID starting with 33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469 not found: ID does not exist" containerID="33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469"
Oct 30 21:15:53.182036 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:53.181997    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469"} err="failed to get container status \"33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469\": rpc error: code = NotFound desc = could not find container \"33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469\": container with ID starting with 33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469 not found: ID does not exist"
Oct 30 21:15:53.182036 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:53.182016    4948 scope.go:122] "RemoveContainer" containerID="8a2d12965217875cb96eacd75466a23ef4907f3af5660723133072d6b6dc44b0"
Oct 30 21:15:53.182317 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:15:53.182298    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a2d12965217875cb96eacd75466a23ef4907f3af5660723133072d6b6dc44b0\": container with ID starting with 8a2d12965217875cb96eacd75466a23ef4907f3af5660723133072d6b6dc44b0 not found: ID does not exist" containerID="8a2d12965217875cb96eacd75466a23ef4907f3af5660723133072d6b6dc44b0"
Oct 30 21:15:53.182426 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:53.182333    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a2d12965217875cb96eacd75466a23ef4907f3af5660723133072d6b6dc44b0"} err="failed to get container status \"8a2d12965217875cb96eacd75466a23ef4907f3af5660723133072d6b6dc44b0\": rpc error: code = NotFound desc = could not find container \"8a2d12965217875cb96eacd75466a23ef4907f3af5660723133072d6b6dc44b0\": container with ID starting with 8a2d12965217875cb96eacd75466a23ef4907f3af5660723133072d6b6dc44b0 not found: ID does not exist"
Oct 30 21:15:53.186067 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:53.186034    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"]
Oct 30 21:15:53.190617 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:53.190583    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-single-main-49a6a4-openshift-default-6f54fd644fkcxbh"]
Oct 30 21:15:53.930071 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:15:53.930032    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:15:54.294321 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:54.294226    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b146d379-1e46-4114-8ff5-d5406924fc24" path="/var/lib/kubelet/pods/b146d379-1e46-4114-8ff5-d5406924fc24/volumes"
Oct 30 21:15:55.675772 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:15:55.675727    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st" podUID="63ba95a0-f120-44f2-ab47-4f1c04a4186a" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:15:57.291107 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:15:57.291061    4948 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb146d379_1e46_4114_8ff5_d5406924fc24.slice/crio-conmon-33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:15:58.010541 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:15:58.010496    4948 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb146d379_1e46_4114_8ff5_d5406924fc24.slice/crio-conmon-33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:16:05.227374 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:05.227218    4948 generic.go:356] "Generic (PLEG): container finished" podID="63ba95a0-f120-44f2-ab47-4f1c04a4186a" containerID="b9210556f09e5443139b5a3987d04ef3b998c21b64135bb9f610682ca19dcc33" exitCode=0
Oct 30 21:16:05.227374 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:05.227284    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st" event={"ID":"63ba95a0-f120-44f2-ab47-4f1c04a4186a","Type":"ContainerDied","Data":"b9210556f09e5443139b5a3987d04ef3b998c21b64135bb9f610682ca19dcc33"}
Oct 30 21:16:05.305285 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:05.305252    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"
Oct 30 21:16:05.339729 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:05.339687    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/63ba95a0-f120-44f2-ab47-4f1c04a4186a-kube-api-access-psnz6\" (UniqueName: \"kubernetes.io/projected/63ba95a0-f120-44f2-ab47-4f1c04a4186a-kube-api-access-psnz6\") pod \"63ba95a0-f120-44f2-ab47-4f1c04a4186a\" (UID: \"63ba95a0-f120-44f2-ab47-4f1c04a4186a\") "
Oct 30 21:16:05.339948 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:05.339827    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/63ba95a0-f120-44f2-ab47-4f1c04a4186a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63ba95a0-f120-44f2-ab47-4f1c04a4186a-plugins-config-volume\") pod \"63ba95a0-f120-44f2-ab47-4f1c04a4186a\" (UID: \"63ba95a0-f120-44f2-ab47-4f1c04a4186a\") "
Oct 30 21:16:05.340344 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:05.340312    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63ba95a0-f120-44f2-ab47-4f1c04a4186a-plugins-config-volume" pod "63ba95a0-f120-44f2-ab47-4f1c04a4186a" (UID: "63ba95a0-f120-44f2-ab47-4f1c04a4186a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:16:05.342103 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:05.342070    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63ba95a0-f120-44f2-ab47-4f1c04a4186a-kube-api-access-psnz6" pod "63ba95a0-f120-44f2-ab47-4f1c04a4186a" (UID: "63ba95a0-f120-44f2-ab47-4f1c04a4186a"). InnerVolumeSpecName "kube-api-access-psnz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:16:05.441574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:05.441528    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psnz6\" (UniqueName: \"kubernetes.io/projected/63ba95a0-f120-44f2-ab47-4f1c04a4186a-kube-api-access-psnz6\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:16:05.441574 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:05.441564    4948 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63ba95a0-f120-44f2-ab47-4f1c04a4186a-plugins-config-volume\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:16:06.234335 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:06.234297    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st" event={"ID":"63ba95a0-f120-44f2-ab47-4f1c04a4186a","Type":"ContainerDied","Data":"9995d0d45531ed999bbf9eb7831e79b0d5f895584a8f6533d376c7bd87dca8a1"}
Oct 30 21:16:06.234835 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:06.234339    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"
Oct 30 21:16:06.234835 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:06.234391    4948 scope.go:122] "RemoveContainer" containerID="b9210556f09e5443139b5a3987d04ef3b998c21b64135bb9f610682ca19dcc33"
Oct 30 21:16:06.258655 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:06.258614    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"]
Oct 30 21:16:06.261265 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:06.261232    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-49a6a4-855b65t9st"]
Oct 30 21:16:06.293563 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:06.293527    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="63ba95a0-f120-44f2-ab47-4f1c04a4186a" path="/var/lib/kubelet/pods/63ba95a0-f120-44f2-ab47-4f1c04a4186a/volumes"
Oct 30 21:16:07.350452 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:16:07.350394    4948 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb146d379_1e46_4114_8ff5_d5406924fc24.slice/crio-conmon-33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:16:11.515694 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:11.515653    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:12.427656 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:12.427617    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:13.049485 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:16:13.049421    4948 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb146d379_1e46_4114_8ff5_d5406924fc24.slice/crio-conmon-33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:16:16.847684 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:16.847634    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:17.053999 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:17.053957    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:17.363379 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:16:17.363327    4948 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb146d379_1e46_4114_8ff5_d5406924fc24.slice/crio-conmon-33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:16:18.418230 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:18.418175    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:19.031011 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:16:19.030966    4948 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb146d379_1e46_4114_8ff5_d5406924fc24.slice/crio-conmon-33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:16:19.031239 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:16:19.031024    4948 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb146d379_1e46_4114_8ff5_d5406924fc24.slice/crio-conmon-33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:16:23.929351 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:16:23.929303    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:16:26.139004 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.138961    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"]
Oct 30 21:16:26.139605 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.139584    4948 cpu_manager.go:414] "containerMap: removing container" podUID="63ba95a0-f120-44f2-ab47-4f1c04a4186a" containerName="payload-pre-processing"
Oct 30 21:16:26.139652 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.139608    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="63ba95a0-f120-44f2-ab47-4f1c04a4186a" containerName="payload-pre-processing"
Oct 30 21:16:26.139652 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.139628    4948 cpu_manager.go:414] "containerMap: removing container" podUID="b1e40274-2332-48f9-acfd-f3f1428a7af3" containerName="cleanup"
Oct 30 21:16:26.139652 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.139637    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1e40274-2332-48f9-acfd-f3f1428a7af3" containerName="cleanup"
Oct 30 21:16:26.139787 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.139659    4948 cpu_manager.go:414] "containerMap: removing container" podUID="b146d379-1e46-4114-8ff5-d5406924fc24" containerName="istio-proxy"
Oct 30 21:16:26.139787 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.139667    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b146d379-1e46-4114-8ff5-d5406924fc24" containerName="istio-proxy"
Oct 30 21:16:26.139787 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.139690    4948 cpu_manager.go:414] "containerMap: removing container" podUID="b1e40274-2332-48f9-acfd-f3f1428a7af3" containerName="cleanup"
Oct 30 21:16:26.139787 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.139698    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1e40274-2332-48f9-acfd-f3f1428a7af3" containerName="cleanup"
Oct 30 21:16:26.139787 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.139726    4948 cpu_manager.go:414] "containerMap: removing container" podUID="b146d379-1e46-4114-8ff5-d5406924fc24" containerName="istio-proxy"
Oct 30 21:16:26.139787 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.139734    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b146d379-1e46-4114-8ff5-d5406924fc24" containerName="istio-proxy"
Oct 30 21:16:26.140073 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.139837    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1e40274-2332-48f9-acfd-f3f1428a7af3" containerName="cleanup"
Oct 30 21:16:26.140073 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.139856    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="b146d379-1e46-4114-8ff5-d5406924fc24" containerName="istio-proxy"
Oct 30 21:16:26.140073 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.139866    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1e40274-2332-48f9-acfd-f3f1428a7af3" containerName="cleanup"
Oct 30 21:16:26.140073 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.139876    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1e40274-2332-48f9-acfd-f3f1428a7af3" containerName="cleanup"
Oct 30 21:16:26.140073 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.139890    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="b146d379-1e46-4114-8ff5-d5406924fc24" containerName="istio-proxy"
Oct 30 21:16:26.140073 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.139901    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="63ba95a0-f120-44f2-ab47-4f1c04a4186a" containerName="payload-pre-processing"
Oct 30 21:16:26.143540 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.143512    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.159473 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.159436    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"]
Oct 30 21:16:26.257517 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.257469    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50064880-6515-47ea-91f3-7e236b73eaf0-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.257517 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.257517    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50064880-6515-47ea-91f3-7e236b73eaf0-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.257751 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.257534    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50064880-6515-47ea-91f3-7e236b73eaf0-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.257751 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.257670    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50064880-6515-47ea-91f3-7e236b73eaf0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.257751 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.257737    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50064880-6515-47ea-91f3-7e236b73eaf0-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.257858 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.257837    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50064880-6515-47ea-91f3-7e236b73eaf0-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.257901 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.257882    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50064880-6515-47ea-91f3-7e236b73eaf0-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.257962 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.257949    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50064880-6515-47ea-91f3-7e236b73eaf0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.258001 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.257976    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z8s8\" (UniqueName: \"kubernetes.io/projected/50064880-6515-47ea-91f3-7e236b73eaf0-kube-api-access-2z8s8\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.358844 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.358800    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50064880-6515-47ea-91f3-7e236b73eaf0-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.359051 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.358950    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50064880-6515-47ea-91f3-7e236b73eaf0-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.359051 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.358983    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50064880-6515-47ea-91f3-7e236b73eaf0-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.359051 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.359003    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50064880-6515-47ea-91f3-7e236b73eaf0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.359051 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.359028    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z8s8\" (UniqueName: \"kubernetes.io/projected/50064880-6515-47ea-91f3-7e236b73eaf0-kube-api-access-2z8s8\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.359248 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.359083    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50064880-6515-47ea-91f3-7e236b73eaf0-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.359248 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.359111    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50064880-6515-47ea-91f3-7e236b73eaf0-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.359248 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.359136    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50064880-6515-47ea-91f3-7e236b73eaf0-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.359248 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.359164    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50064880-6515-47ea-91f3-7e236b73eaf0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.359468 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.359288    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50064880-6515-47ea-91f3-7e236b73eaf0-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.359468 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.359390    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50064880-6515-47ea-91f3-7e236b73eaf0-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.359676 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.359655    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50064880-6515-47ea-91f3-7e236b73eaf0-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.359739 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.359673    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50064880-6515-47ea-91f3-7e236b73eaf0-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.359922 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.359900    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50064880-6515-47ea-91f3-7e236b73eaf0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.361507 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.361485    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50064880-6515-47ea-91f3-7e236b73eaf0-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.361885 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.361864    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50064880-6515-47ea-91f3-7e236b73eaf0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.372244 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.372212    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50064880-6515-47ea-91f3-7e236b73eaf0-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.372387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.372265    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z8s8\" (UniqueName: \"kubernetes.io/projected/50064880-6515-47ea-91f3-7e236b73eaf0-kube-api-access-2z8s8\") pod \"maas-default-gateway-openshift-default-58c6585447-s5sz7\" (UID: \"50064880-6515-47ea-91f3-7e236b73eaf0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.463483 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.463347    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:26.751984 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.751930    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"]
Oct 30 21:16:26.754802 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:16:26.754771    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50064880_6515_47ea_91f3_7e236b73eaf0.slice/crio-62bb930dbaaa19da4ddd173a15fab984cb393b0305af81ed59f969e094b58e69 WatchSource:0}: Error finding container 62bb930dbaaa19da4ddd173a15fab984cb393b0305af81ed59f969e094b58e69: Status 404 returned error can't find the container with id 62bb930dbaaa19da4ddd173a15fab984cb393b0305af81ed59f969e094b58e69
Oct 30 21:16:26.757333 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.757293    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:16:26.757471 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.757435    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:16:26.757512 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:26.757471    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:16:27.340875 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:27.340835    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7" event={"ID":"50064880-6515-47ea-91f3-7e236b73eaf0","Type":"ContainerStarted","Data":"0ef3803ce42a44122b95e98912df25e19a1460f47386b45eb894ad4c3a7478c4"}
Oct 30 21:16:27.341342 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:27.340897    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7" event={"ID":"50064880-6515-47ea-91f3-7e236b73eaf0","Type":"ContainerStarted","Data":"62bb930dbaaa19da4ddd173a15fab984cb393b0305af81ed59f969e094b58e69"}
Oct 30 21:16:27.365901 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:27.365835    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7" podStartSLOduration=1.365818667 podStartE2EDuration="1.365818667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:27.364070899 +0000 UTC m=+2255.183582888" watchObservedRunningTime="2026-10-30 21:16:27.365818667 +0000 UTC m=+2255.185330655"
Oct 30 21:16:27.419491 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:16:27.419449    4948 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb146d379_1e46_4114_8ff5_d5406924fc24.slice/crio-conmon-33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:16:27.464084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:27.464034    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:27.469719 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:27.469685    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:28.029033 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:16:28.028988    4948 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb146d379_1e46_4114_8ff5_d5406924fc24.slice/crio-conmon-33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:16:28.346404 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:28.346349    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:28.347548 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:28.347527    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:16:37.474657 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:16:37.474611    4948 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb146d379_1e46_4114_8ff5_d5406924fc24.slice/crio-conmon-33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:16:41.165081 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.165036    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"]
Oct 30 21:16:41.165751 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.165727    4948 cpu_manager.go:414] "containerMap: removing container" podUID="b1e40274-2332-48f9-acfd-f3f1428a7af3" containerName="cleanup"
Oct 30 21:16:41.165841 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.165753    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1e40274-2332-48f9-acfd-f3f1428a7af3" containerName="cleanup"
Oct 30 21:16:41.169627 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.169597    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.186801 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.186760    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"]
Oct 30 21:16:41.220539 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.220495    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.220746 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.220544    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.220746 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.220659    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.220746 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.220687    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.220746 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.220726    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.220977 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.220886    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.220977 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.220937    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.221135 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.220989    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vd6n\" (UniqueName: \"kubernetes.io/projected/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-kube-api-access-5vd6n\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.221135 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.221117    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.322740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.322688    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.322740 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.322753    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.323042 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.322776    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.323042 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.322809    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vd6n\" (UniqueName: \"kubernetes.io/projected/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-kube-api-access-5vd6n\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.323042 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.322843    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.323042 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.322887    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.323042 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.322915    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.323042 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.322963    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.323344 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.323105    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.323344 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.323244    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.323344 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.323305    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.323511 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.323420    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.323511 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.323489    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.323660 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.323643    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.325575 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.325545    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.325706 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.325652    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.335899 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.335866    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.336047 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.336025    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vd6n\" (UniqueName: \"kubernetes.io/projected/1a79c6f2-f405-4bf1-b639-8be072ae6a5a-kube-api-access-5vd6n\") pod \"maas-default-gateway-openshift-default-58c6585447-b5gx2\" (UID: \"1a79c6f2-f405-4bf1-b639-8be072ae6a5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.487190 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.487089    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:41.775097 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.774882    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"]
Oct 30 21:16:41.778284 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:16:41.778242    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a79c6f2_f405_4bf1_b639_8be072ae6a5a.slice/crio-1c955c2acfda8c19a0566d0a9b32e90a0132120959998f8ea3615f2b007c750d WatchSource:0}: Error finding container 1c955c2acfda8c19a0566d0a9b32e90a0132120959998f8ea3615f2b007c750d: Status 404 returned error can't find the container with id 1c955c2acfda8c19a0566d0a9b32e90a0132120959998f8ea3615f2b007c750d
Oct 30 21:16:41.780781 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.780740    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:16:41.780890 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.780816    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:16:41.780890 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:41.780851    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:16:42.420693 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:42.420642    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2" event={"ID":"1a79c6f2-f405-4bf1-b639-8be072ae6a5a","Type":"ContainerStarted","Data":"51b9ef97fb05b494c2c454729ed0ab2d0351dc994fe196e9703ec9f555ba5545"}
Oct 30 21:16:42.421144 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:42.420710    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2" event={"ID":"1a79c6f2-f405-4bf1-b639-8be072ae6a5a","Type":"ContainerStarted","Data":"1c955c2acfda8c19a0566d0a9b32e90a0132120959998f8ea3615f2b007c750d"}
Oct 30 21:16:42.447815 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:42.447756    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2" podStartSLOduration=1.4477385919999999 podStartE2EDuration="1.447738592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:42.445209207 +0000 UTC m=+2270.264721207" watchObservedRunningTime="2026-10-30 21:16:42.447738592 +0000 UTC m=+2270.267250653"
Oct 30 21:16:42.488117 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:42.488067    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:42.489617 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:42.489585    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-b5gx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 21:16:42.489726 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:42.489650    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2" podUID="1a79c6f2-f405-4bf1-b639-8be072ae6a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 21:16:43.054433 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:16:43.054394    4948 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb146d379_1e46_4114_8ff5_d5406924fc24.slice/crio-conmon-33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:16:43.493662 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:43.493627    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:44.431786 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:44.431751    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:44.432977 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:44.432950    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:16:45.061859 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:16:45.061792    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:47.486941 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:16:47.486899    4948 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb146d379_1e46_4114_8ff5_d5406924fc24.slice/crio-conmon-33bd7a635130c036e9bcf208e36adf787981f1e68c7273c37eb7ee7aa8e5d469.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:16:53.929803 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:16:53.929760    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:17:23.930175 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:17:23.930123    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:17:28.623113 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:17:28.623075    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:45.131089 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:17:45.131042    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:54.049978 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:17:54.049888    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:18:00.473534 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:00.473492    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-b5gx2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:18:00.474053 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:00.473567    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2" podUID="1a79c6f2-f405-4bf1-b639-8be072ae6a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:18:01.861029 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:01.860990    4948 generic.go:356] "Generic (PLEG): container finished" podID="1a79c6f2-f405-4bf1-b639-8be072ae6a5a" containerID="51b9ef97fb05b494c2c454729ed0ab2d0351dc994fe196e9703ec9f555ba5545" exitCode=0
Oct 30 21:18:01.862603 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:01.861060    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2" event={"ID":"1a79c6f2-f405-4bf1-b639-8be072ae6a5a","Type":"ContainerDied","Data":"51b9ef97fb05b494c2c454729ed0ab2d0351dc994fe196e9703ec9f555ba5545"}
Oct 30 21:18:01.862603 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:01.861512    4948 scope.go:122] "RemoveContainer" containerID="51b9ef97fb05b494c2c454729ed0ab2d0351dc994fe196e9703ec9f555ba5545"
Oct 30 21:18:01.862979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:01.862763    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:18:01.862979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:01.862836    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:18:01.862979 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:01.862873    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:18:02.881128 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:02.881092    4948 generic.go:356] "Generic (PLEG): container finished" podID="50064880-6515-47ea-91f3-7e236b73eaf0" containerID="0ef3803ce42a44122b95e98912df25e19a1460f47386b45eb894ad4c3a7478c4" exitCode=0
Oct 30 21:18:02.881622 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:02.881268    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7" event={"ID":"50064880-6515-47ea-91f3-7e236b73eaf0","Type":"ContainerDied","Data":"0ef3803ce42a44122b95e98912df25e19a1460f47386b45eb894ad4c3a7478c4"}
Oct 30 21:18:02.881704 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:02.881692    4948 scope.go:122] "RemoveContainer" containerID="0ef3803ce42a44122b95e98912df25e19a1460f47386b45eb894ad4c3a7478c4"
Oct 30 21:18:02.884719 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:02.884687    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:18:02.884857 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:02.884774    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:18:02.884857 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:02.884825    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:18:02.887052 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:02.886931    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2" event={"ID":"1a79c6f2-f405-4bf1-b639-8be072ae6a5a","Type":"ContainerStarted","Data":"2608384ea782a8bf124bc76837832f073f185cc8954a41e5cacc1f4a8b1176c7"}
Oct 30 21:18:03.489387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:03.488985    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:18:03.489631 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:03.489469    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-b5gx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 21:18:03.489631 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:03.489527    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2" podUID="1a79c6f2-f405-4bf1-b639-8be072ae6a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 21:18:03.904228 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:03.904181    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7" event={"ID":"50064880-6515-47ea-91f3-7e236b73eaf0","Type":"ContainerStarted","Data":"6b753b6e27ce767a4e027c19f9c9243b3dafc7f315e1995decc76191e07d44f3"}
Oct 30 21:18:04.472392 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:04.471489    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-s5sz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:18:04.472392 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:04.471561    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7" podUID="50064880-6515-47ea-91f3-7e236b73eaf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 21:18:04.472392 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:04.471683    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:18:04.491410 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:04.490871    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-b5gx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 21:18:04.491410 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:04.490952    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2" podUID="1a79c6f2-f405-4bf1-b639-8be072ae6a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 21:18:05.470389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:05.467877    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-s5sz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:18:05.470389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:05.467958    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7" podUID="50064880-6515-47ea-91f3-7e236b73eaf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 21:18:05.500279 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:05.499788    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-b5gx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 21:18:05.500279 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:05.499865    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2" podUID="1a79c6f2-f405-4bf1-b639-8be072ae6a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 21:18:06.477389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:06.470893    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-s5sz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:18:06.477389 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:06.470972    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7" podUID="50064880-6515-47ea-91f3-7e236b73eaf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 21:18:06.499347 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:06.488966    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-b5gx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 21:18:06.499347 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:06.489064    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2" podUID="1a79c6f2-f405-4bf1-b639-8be072ae6a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 21:18:07.465923 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:07.465874    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-s5sz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:18:07.466276 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:07.466244    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7" podUID="50064880-6515-47ea-91f3-7e236b73eaf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 21:18:07.495140 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:07.495098    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-b5gx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 21:18:07.495862 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:07.495823    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2" podUID="1a79c6f2-f405-4bf1-b639-8be072ae6a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 21:18:08.464387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:08.463977    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-s5sz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:18:08.464387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:08.464062    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7" podUID="50064880-6515-47ea-91f3-7e236b73eaf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 21:18:08.487905 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:08.487863    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-b5gx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 21:18:08.488108 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:08.487931    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2" podUID="1a79c6f2-f405-4bf1-b639-8be072ae6a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 21:18:09.463991 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:09.463942    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-s5sz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:18:09.464564 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:09.464019    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7" podUID="50064880-6515-47ea-91f3-7e236b73eaf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 21:18:09.488272 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:09.488230    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-b5gx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 21:18:09.488567 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:09.488290    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2" podUID="1a79c6f2-f405-4bf1-b639-8be072ae6a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 21:18:10.464149 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:10.464102    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-s5sz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 21:18:10.464754 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:10.464177    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7" podUID="50064880-6515-47ea-91f3-7e236b73eaf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 21:18:10.534627 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:10.534588    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:18:10.535048 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:10.535017    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:18:10.536060 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:10.536041    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2"
Oct 30 21:18:11.576702 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:11.576666    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:18:11.577214 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:11.577122    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:18:11.578234 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:11.578213    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7"
Oct 30 21:18:23.928861 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:18:23.928820    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:18:32.148253 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:32.148203    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:32.625707 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:32.625654    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:32.832642 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:32.832605    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:33.295086 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:33.295049    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:36.131470 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:36.131345    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:36.392324 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:36.392221    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:37.228489 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.228452    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"]
Oct 30 21:18:37.231244 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.231224    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"
Oct 30 21:18:37.243169 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.243130    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"]
Oct 30 21:18:37.251783 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.251746    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"]
Oct 30 21:18:37.255110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.255074    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"
Oct 30 21:18:37.264801 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.264772    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-single-main-11b629\""
Oct 30 21:18:37.265456 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.265434    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-single-m-11a87bb6-dockercfg-wksvd\""
Oct 30 21:18:37.267944 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.267911    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"]
Oct 30 21:18:37.299120 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.299075    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:37.324312 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.324270    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntbkh\" (UniqueName: \"kubernetes.io/projected/139b1ce3-36cf-431f-a33f-1a9b5f59cc67-kube-api-access-ntbkh\") pod \"payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2\" (UID: \"139b1ce3-36cf-431f-a33f-1a9b5f59cc67\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"
Oct 30 21:18:37.324560 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.324435    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/139b1ce3-36cf-431f-a33f-1a9b5f59cc67-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2\" (UID: \"139b1ce3-36cf-431f-a33f-1a9b5f59cc67\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"
Oct 30 21:18:37.324560 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.324460    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv\" (UID: \"80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"
Oct 30 21:18:37.324681 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.324666    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xrjd\" (UniqueName: \"kubernetes.io/projected/80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d-kube-api-access-8xrjd\") pod \"payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv\" (UID: \"80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"
Oct 30 21:18:37.425986 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.425945    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntbkh\" (UniqueName: \"kubernetes.io/projected/139b1ce3-36cf-431f-a33f-1a9b5f59cc67-kube-api-access-ntbkh\") pod \"payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2\" (UID: \"139b1ce3-36cf-431f-a33f-1a9b5f59cc67\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"
Oct 30 21:18:37.426188 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.426051    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/139b1ce3-36cf-431f-a33f-1a9b5f59cc67-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2\" (UID: \"139b1ce3-36cf-431f-a33f-1a9b5f59cc67\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"
Oct 30 21:18:37.426188 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.426072    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv\" (UID: \"80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"
Oct 30 21:18:37.426286 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.426243    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xrjd\" (UniqueName: \"kubernetes.io/projected/80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d-kube-api-access-8xrjd\") pod \"payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv\" (UID: \"80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"
Oct 30 21:18:37.426944 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.426919    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/139b1ce3-36cf-431f-a33f-1a9b5f59cc67-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2\" (UID: \"139b1ce3-36cf-431f-a33f-1a9b5f59cc67\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"
Oct 30 21:18:37.427043 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.426964    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv\" (UID: \"80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"
Oct 30 21:18:37.439544 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.439511    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntbkh\" (UniqueName: \"kubernetes.io/projected/139b1ce3-36cf-431f-a33f-1a9b5f59cc67-kube-api-access-ntbkh\") pod \"payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2\" (UID: \"139b1ce3-36cf-431f-a33f-1a9b5f59cc67\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"
Oct 30 21:18:37.439544 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.439513    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xrjd\" (UniqueName: \"kubernetes.io/projected/80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d-kube-api-access-8xrjd\") pod \"payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv\" (UID: \"80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"
Oct 30 21:18:37.536947 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.536852    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:37.545751 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.545708    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"
Oct 30 21:18:37.575401 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.575334    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"
Oct 30 21:18:37.828686 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.828507    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"]
Oct 30 21:18:37.831516 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:18:37.831475    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod139b1ce3_36cf_431f_a33f_1a9b5f59cc67.slice/crio-a07e26623c86777e6d0fc17333e5d00e745af1b1ad50b8b7acc162d477fbfabc WatchSource:0}: Error finding container a07e26623c86777e6d0fc17333e5d00e745af1b1ad50b8b7acc162d477fbfabc: Status 404 returned error can't find the container with id a07e26623c86777e6d0fc17333e5d00e745af1b1ad50b8b7acc162d477fbfabc
Oct 30 21:18:37.868681 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:37.867590    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"]
Oct 30 21:18:37.877937 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:18:37.877891    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f375f4_dece_48e3_bcf4_8a7aa3a5fe0d.slice/crio-88b8d2694145ce1e0672a0586e21669c52a31ac0d1671628a8af1a1ceb22ae07 WatchSource:0}: Error finding container 88b8d2694145ce1e0672a0586e21669c52a31ac0d1671628a8af1a1ceb22ae07: Status 404 returned error can't find the container with id 88b8d2694145ce1e0672a0586e21669c52a31ac0d1671628a8af1a1ceb22ae07
Oct 30 21:18:38.118137 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:38.112011    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2" event={"ID":"139b1ce3-36cf-431f-a33f-1a9b5f59cc67","Type":"ContainerStarted","Data":"9a25c0eec246c93449c6c8a0191af6e6fb532e0e961888e28fe1d3f5843d3717"}
Oct 30 21:18:38.118137 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:38.112087    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2" event={"ID":"139b1ce3-36cf-431f-a33f-1a9b5f59cc67","Type":"ContainerStarted","Data":"a07e26623c86777e6d0fc17333e5d00e745af1b1ad50b8b7acc162d477fbfabc"}
Oct 30 21:18:38.118137 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:38.113092    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"
Oct 30 21:18:38.118137 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:38.115148    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv" event={"ID":"80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d","Type":"ContainerStarted","Data":"7d92a51546940edf7cf6890d81a9f173444c9a0a6527df0de4447390c52c8097"}
Oct 30 21:18:38.118137 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:38.115202    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv" event={"ID":"80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d","Type":"ContainerStarted","Data":"88b8d2694145ce1e0672a0586e21669c52a31ac0d1671628a8af1a1ceb22ae07"}
Oct 30 21:18:38.118137 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:38.115970    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"
Oct 30 21:18:38.133160 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:38.133056    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2" podStartSLOduration=1.133033637 podStartE2EDuration="1.133033637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:18:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:18:38.131181436 +0000 UTC m=+2385.950693427" watchObservedRunningTime="2026-10-30 21:18:38.133033637 +0000 UTC m=+2385.952545626"
Oct 30 21:18:38.149774 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:38.149693    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv" podStartSLOduration=1.149674925 podStartE2EDuration="1.149674925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:18:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:18:38.149404329 +0000 UTC m=+2385.968916318" watchObservedRunningTime="2026-10-30 21:18:38.149674925 +0000 UTC m=+2385.969186914"
Oct 30 21:18:38.165759 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:38.165721    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:38.903158 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:38.903114    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:39.582530 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:39.582493    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:40.284042 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:40.283987    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:41.081103 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:41.081061    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:41.803758 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:41.803719    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:42.002073 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:42.002032    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:42.497775 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:42.497729    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:43.197096 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:43.197046    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:43.888861 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:43.888815    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:44.690771 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:44.690740    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:45.177891 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:45.177819    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:45.532164 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:45.532072    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:45.965423 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:45.965385    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:46.290793 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:46.290678    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:46.568777 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:46.568671    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:46.771861 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:46.771812    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:47.331378 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:47.331325    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:47.896502 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:47.896464    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:48.571336 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:48.571299    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:48.778281 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:48.778235    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:49.395216 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:49.395175    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:50.084766 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:50.084723    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:50.128280 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:50.128250    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"
Oct 30 21:18:50.128511 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:50.128333    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"
Oct 30 21:18:50.988813 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:50.988775    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:51.808798 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:51.808758    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:52.593635 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:52.593584    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:52.626967 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:52.626928    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 21:18:52.632547 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:52.632518    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 21:18:53.303276 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:53.303246    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:53.929004 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:18:53.928963    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:18:54.001069 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:54.001030    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:54.705081 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:54.705040    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:55.392829 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:55.392786    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:56.175577 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:56.175528    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:57.058183 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:57.058144    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:57.891770 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:57.891734    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:58.622853 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:58.622818    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:59.527931 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:18:59.527882    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:00.333116 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:00.333081    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:00.994761 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:00.994720    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:01.704832 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:01.704794    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:02.448169 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:02.448125    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:03.195407 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:03.195350    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:03.933311 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:03.933267    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:04.794571 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:04.794535    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:05.501401 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:05.501335    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:06.414494 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:06.414453    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:07.295905 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:07.295859    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:08.005177 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:08.005125    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:08.699019 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:08.698966    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:09.420735 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:09.420693    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:10.101167 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:10.101130    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:10.870991 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:10.870943    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:11.645079 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:11.645036    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:12.397032 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:12.396992    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:13.112468 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:13.112429    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:13.841155 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:13.841113    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:14.695546 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:14.695500    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:15.491973 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:15.491925    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:16.286540 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:16.286473    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:17.000564 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:17.000524    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:17.787556 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:17.787520    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:18.512992 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:18.512954    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:19.329540 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:19.329494    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:20.370256 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:20.370209    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:21.111198 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:21.111158    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:21.875803 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:21.875758    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:22.694393 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:22.694331    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:23.400518 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:23.400476    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:23.931430 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:19:23.931386    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:19:24.142249 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:24.142201    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:24.875008 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:24.874970    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:25.593136 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:25.593092    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:26.401035 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:26.400994    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:27.096734 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:27.096694    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:27.805033 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:27.804998    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:28.570913 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:28.570874    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:29.151724 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:29.151687    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:29.394536 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:29.394493    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:30.202064 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:30.202028    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:31.000142 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:31.000098    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:31.705604 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:31.705550    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:32.414765 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:32.414725    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:33.287042 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:33.287000    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:33.991091 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:33.991038    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:34.192776 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:34.192738    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:34.693279 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:34.693244    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:35.445839 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:35.445799    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:36.229095 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:36.229059    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:36.909393 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:36.909338    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:37.597694 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:37.597654    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:38.388536 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:38.388492    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:39.110487 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:39.110454    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:39.236609 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:39.236552    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"]
Oct 30 21:19:39.242164 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:39.242118    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"]
Oct 30 21:19:39.395929 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:39.395844    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:39.598623 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:39.598588    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:39.811923 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:39.811834    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:40.018824 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:40.018783    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:40.637991 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:40.637950    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:44.237918 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:44.237834    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2" podUID="139b1ce3-36cf-431f-a33f-1a9b5f59cc67" containerName="payload-processing" containerID="cri-o://9a25c0eec246c93449c6c8a0191af6e6fb532e0e961888e28fe1d3f5843d3717" gracePeriod=25
Oct 30 21:19:44.242542 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:44.242500    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv" podUID="80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d" containerName="payload-pre-processing" containerID="cri-o://7d92a51546940edf7cf6890d81a9f173444c9a0a6527df0de4447390c52c8097" gracePeriod=25
Oct 30 21:19:45.233925 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:45.233869    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:47.076197 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:47.076140    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:47.346976 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:47.346943    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:47.645972 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:47.645859    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:50.127056 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:50.127007    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv" podUID="80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:19:50.127056 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:50.127038    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2" podUID="139b1ce3-36cf-431f-a33f-1a9b5f59cc67" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:19:52.265686 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:52.265455    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:53.929565 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:19:53.929521    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:19:56.586522 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:56.586474    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-b5gx2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:19:56.587170 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:19:56.587127    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2" podUID="1a79c6f2-f405-4bf1-b639-8be072ae6a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:20:00.126611 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:00.126567    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv" podUID="80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:20:00.126611 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:00.126587    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2" podUID="139b1ce3-36cf-431f-a33f-1a9b5f59cc67" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:20:04.502175 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.502092    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"
Oct 30 21:20:04.533694 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.533663    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"
Oct 30 21:20:04.610555 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.610520    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/139b1ce3-36cf-431f-a33f-1a9b5f59cc67-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/139b1ce3-36cf-431f-a33f-1a9b5f59cc67-plugins-config-volume\") pod \"139b1ce3-36cf-431f-a33f-1a9b5f59cc67\" (UID: \"139b1ce3-36cf-431f-a33f-1a9b5f59cc67\") "
Oct 30 21:20:04.610787 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.610616    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/139b1ce3-36cf-431f-a33f-1a9b5f59cc67-kube-api-access-ntbkh\" (UniqueName: \"kubernetes.io/projected/139b1ce3-36cf-431f-a33f-1a9b5f59cc67-kube-api-access-ntbkh\") pod \"139b1ce3-36cf-431f-a33f-1a9b5f59cc67\" (UID: \"139b1ce3-36cf-431f-a33f-1a9b5f59cc67\") "
Oct 30 21:20:04.611002 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.610975    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/139b1ce3-36cf-431f-a33f-1a9b5f59cc67-plugins-config-volume" pod "139b1ce3-36cf-431f-a33f-1a9b5f59cc67" (UID: "139b1ce3-36cf-431f-a33f-1a9b5f59cc67"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:20:04.612953 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.612923    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/139b1ce3-36cf-431f-a33f-1a9b5f59cc67-kube-api-access-ntbkh" pod "139b1ce3-36cf-431f-a33f-1a9b5f59cc67" (UID: "139b1ce3-36cf-431f-a33f-1a9b5f59cc67"). InnerVolumeSpecName "kube-api-access-ntbkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:20:04.678841 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.678797    4948 generic.go:356] "Generic (PLEG): container finished" podID="80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d" containerID="7d92a51546940edf7cf6890d81a9f173444c9a0a6527df0de4447390c52c8097" exitCode=0
Oct 30 21:20:04.678841 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.678841    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"
Oct 30 21:20:04.679118 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.678868    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv" event={"ID":"80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d","Type":"ContainerDied","Data":"7d92a51546940edf7cf6890d81a9f173444c9a0a6527df0de4447390c52c8097"}
Oct 30 21:20:04.679118 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.678917    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv" event={"ID":"80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d","Type":"ContainerDied","Data":"88b8d2694145ce1e0672a0586e21669c52a31ac0d1671628a8af1a1ceb22ae07"}
Oct 30 21:20:04.679118 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.678940    4948 scope.go:122] "RemoveContainer" containerID="7d92a51546940edf7cf6890d81a9f173444c9a0a6527df0de4447390c52c8097"
Oct 30 21:20:04.680415 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.680385    4948 generic.go:356] "Generic (PLEG): container finished" podID="139b1ce3-36cf-431f-a33f-1a9b5f59cc67" containerID="9a25c0eec246c93449c6c8a0191af6e6fb532e0e961888e28fe1d3f5843d3717" exitCode=0
Oct 30 21:20:04.680557 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.680421    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2" event={"ID":"139b1ce3-36cf-431f-a33f-1a9b5f59cc67","Type":"ContainerDied","Data":"9a25c0eec246c93449c6c8a0191af6e6fb532e0e961888e28fe1d3f5843d3717"}
Oct 30 21:20:04.680557 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.680447    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"
Oct 30 21:20:04.680557 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.680474    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2" event={"ID":"139b1ce3-36cf-431f-a33f-1a9b5f59cc67","Type":"ContainerDied","Data":"a07e26623c86777e6d0fc17333e5d00e745af1b1ad50b8b7acc162d477fbfabc"}
Oct 30 21:20:04.688839 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.688706    4948 scope.go:122] "RemoveContainer" containerID="7d92a51546940edf7cf6890d81a9f173444c9a0a6527df0de4447390c52c8097"
Oct 30 21:20:04.689168 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:20:04.689144    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d92a51546940edf7cf6890d81a9f173444c9a0a6527df0de4447390c52c8097\": container with ID starting with 7d92a51546940edf7cf6890d81a9f173444c9a0a6527df0de4447390c52c8097 not found: ID does not exist" containerID="7d92a51546940edf7cf6890d81a9f173444c9a0a6527df0de4447390c52c8097"
Oct 30 21:20:04.689256 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.689176    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d92a51546940edf7cf6890d81a9f173444c9a0a6527df0de4447390c52c8097"} err="failed to get container status \"7d92a51546940edf7cf6890d81a9f173444c9a0a6527df0de4447390c52c8097\": rpc error: code = NotFound desc = could not find container \"7d92a51546940edf7cf6890d81a9f173444c9a0a6527df0de4447390c52c8097\": container with ID starting with 7d92a51546940edf7cf6890d81a9f173444c9a0a6527df0de4447390c52c8097 not found: ID does not exist"
Oct 30 21:20:04.689256 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.689199    4948 scope.go:122] "RemoveContainer" containerID="9a25c0eec246c93449c6c8a0191af6e6fb532e0e961888e28fe1d3f5843d3717"
Oct 30 21:20:04.699131 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.699106    4948 scope.go:122] "RemoveContainer" containerID="9a25c0eec246c93449c6c8a0191af6e6fb532e0e961888e28fe1d3f5843d3717"
Oct 30 21:20:04.699647 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:20:04.699570    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a25c0eec246c93449c6c8a0191af6e6fb532e0e961888e28fe1d3f5843d3717\": container with ID starting with 9a25c0eec246c93449c6c8a0191af6e6fb532e0e961888e28fe1d3f5843d3717 not found: ID does not exist" containerID="9a25c0eec246c93449c6c8a0191af6e6fb532e0e961888e28fe1d3f5843d3717"
Oct 30 21:20:04.699647 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.699606    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a25c0eec246c93449c6c8a0191af6e6fb532e0e961888e28fe1d3f5843d3717"} err="failed to get container status \"9a25c0eec246c93449c6c8a0191af6e6fb532e0e961888e28fe1d3f5843d3717\": rpc error: code = NotFound desc = could not find container \"9a25c0eec246c93449c6c8a0191af6e6fb532e0e961888e28fe1d3f5843d3717\": container with ID starting with 9a25c0eec246c93449c6c8a0191af6e6fb532e0e961888e28fe1d3f5843d3717 not found: ID does not exist"
Oct 30 21:20:04.706942 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.706900    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"]
Oct 30 21:20:04.712420 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.712349    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d-plugins-config-volume\") pod \"80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d\" (UID: \"80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d\") "
Oct 30 21:20:04.712814 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.712791    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d-kube-api-access-8xrjd\" (UniqueName: \"kubernetes.io/projected/80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d-kube-api-access-8xrjd\") pod \"80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d\" (UID: \"80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d\") "
Oct 30 21:20:04.713009 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.712983    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d-plugins-config-volume" pod "80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d" (UID: "80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:20:04.713160 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.713144    4948 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/139b1ce3-36cf-431f-a33f-1a9b5f59cc67-plugins-config-volume\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:20:04.713217 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.713163    4948 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d-plugins-config-volume\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:20:04.713217 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.713177    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntbkh\" (UniqueName: \"kubernetes.io/projected/139b1ce3-36cf-431f-a33f-1a9b5f59cc67-kube-api-access-ntbkh\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:20:04.714708 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.714683    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-11b629-765f8bf6d2hvm2"]
Oct 30 21:20:04.715223 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.715199    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d-kube-api-access-8xrjd" pod "80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d" (UID: "80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d"). InnerVolumeSpecName "kube-api-access-8xrjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:20:04.813853 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:04.813756    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xrjd\" (UniqueName: \"kubernetes.io/projected/80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d-kube-api-access-8xrjd\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:20:05.002273 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:05.002232    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"]
Oct 30 21:20:05.007283 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:05.007248    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-single-main-11b629-85c59lqnqv"]
Oct 30 21:20:06.293710 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:06.293672    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="139b1ce3-36cf-431f-a33f-1a9b5f59cc67" path="/var/lib/kubelet/pods/139b1ce3-36cf-431f-a33f-1a9b5f59cc67/volumes"
Oct 30 21:20:06.294141 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:06.294065    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d" path="/var/lib/kubelet/pods/80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d/volumes"
Oct 30 21:20:08.265435 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:08.265389    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:11.767387 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:11.766636    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:12.689541 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:12.689492    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-s5sz7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:20:12.689879 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:12.689852    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7" podUID="50064880-6515-47ea-91f3-7e236b73eaf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:20:12.867790 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:12.867732    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:18.145531 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:18.145482    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:18.382658 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:18.382620    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:18.689121 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:18.689076    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:23.929101 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:20:23.929057    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:20:36.429859 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:36.429814    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:38.186123 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:38.186083    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:41.579383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:41.579176    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-b5gx2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:20:41.579383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:41.579269    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-b5gx2" podUID="1a79c6f2-f405-4bf1-b639-8be072ae6a5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:20:45.294737 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:45.294692    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:54.045067 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:20:54.044959    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:20:57.624388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:57.623555    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-s5sz7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:20:57.624388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:20:57.623632    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7" podUID="50064880-6515-47ea-91f3-7e236b73eaf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:21:14.550784 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.550740    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"]
Oct 30 21:21:14.551525 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.551497    4948 cpu_manager.go:414] "containerMap: removing container" podUID="80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d" containerName="payload-pre-processing"
Oct 30 21:21:14.551719 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.551693    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d" containerName="payload-pre-processing"
Oct 30 21:21:14.551846 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.551747    4948 cpu_manager.go:414] "containerMap: removing container" podUID="139b1ce3-36cf-431f-a33f-1a9b5f59cc67" containerName="payload-processing"
Oct 30 21:21:14.551846 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.551758    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="139b1ce3-36cf-431f-a33f-1a9b5f59cc67" containerName="payload-processing"
Oct 30 21:21:14.551957 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.551914    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="139b1ce3-36cf-431f-a33f-1a9b5f59cc67" containerName="payload-processing"
Oct 30 21:21:14.551957 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.551941    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="80f375f4-dece-48e3-bcf4-8a7aa3a5fe0d" containerName="payload-pre-processing"
Oct 30 21:21:14.568522 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.568477    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"]
Oct 30 21:21:14.569138 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.569103    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"
Oct 30 21:21:14.626352 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.626308    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5355136-bad5-4326-8993-dc5e89781e90-metrics-certs\") pod \"maas-api-5d4dc8d99b-llkzt\" (UID: \"c5355136-bad5-4326-8993-dc5e89781e90\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"
Oct 30 21:21:14.626569 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.626354    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5355136-bad5-4326-8993-dc5e89781e90-openshift-service-ca\") pod \"maas-api-5d4dc8d99b-llkzt\" (UID: \"c5355136-bad5-4326-8993-dc5e89781e90\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"
Oct 30 21:21:14.626569 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.626487    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5355136-bad5-4326-8993-dc5e89781e90-maas-api-tls\") pod \"maas-api-5d4dc8d99b-llkzt\" (UID: \"c5355136-bad5-4326-8993-dc5e89781e90\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"
Oct 30 21:21:14.626569 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.626516    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlwsh\" (UniqueName: \"kubernetes.io/projected/c5355136-bad5-4326-8993-dc5e89781e90-kube-api-access-qlwsh\") pod \"maas-api-5d4dc8d99b-llkzt\" (UID: \"c5355136-bad5-4326-8993-dc5e89781e90\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"
Oct 30 21:21:14.728085 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.728039    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5355136-bad5-4326-8993-dc5e89781e90-metrics-certs\") pod \"maas-api-5d4dc8d99b-llkzt\" (UID: \"c5355136-bad5-4326-8993-dc5e89781e90\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"
Oct 30 21:21:14.728085 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.728085    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5355136-bad5-4326-8993-dc5e89781e90-openshift-service-ca\") pod \"maas-api-5d4dc8d99b-llkzt\" (UID: \"c5355136-bad5-4326-8993-dc5e89781e90\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"
Oct 30 21:21:14.728381 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.728103    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5355136-bad5-4326-8993-dc5e89781e90-maas-api-tls\") pod \"maas-api-5d4dc8d99b-llkzt\" (UID: \"c5355136-bad5-4326-8993-dc5e89781e90\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"
Oct 30 21:21:14.728381 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.728194    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlwsh\" (UniqueName: \"kubernetes.io/projected/c5355136-bad5-4326-8993-dc5e89781e90-kube-api-access-qlwsh\") pod \"maas-api-5d4dc8d99b-llkzt\" (UID: \"c5355136-bad5-4326-8993-dc5e89781e90\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"
Oct 30 21:21:14.728983 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.728950    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5355136-bad5-4326-8993-dc5e89781e90-openshift-service-ca\") pod \"maas-api-5d4dc8d99b-llkzt\" (UID: \"c5355136-bad5-4326-8993-dc5e89781e90\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"
Oct 30 21:21:14.731015 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.730985    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5355136-bad5-4326-8993-dc5e89781e90-maas-api-tls\") pod \"maas-api-5d4dc8d99b-llkzt\" (UID: \"c5355136-bad5-4326-8993-dc5e89781e90\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"
Oct 30 21:21:14.731132 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.730994    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5355136-bad5-4326-8993-dc5e89781e90-metrics-certs\") pod \"maas-api-5d4dc8d99b-llkzt\" (UID: \"c5355136-bad5-4326-8993-dc5e89781e90\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"
Oct 30 21:21:14.741455 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.741427    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlwsh\" (UniqueName: \"kubernetes.io/projected/c5355136-bad5-4326-8993-dc5e89781e90-kube-api-access-qlwsh\") pod \"maas-api-5d4dc8d99b-llkzt\" (UID: \"c5355136-bad5-4326-8993-dc5e89781e90\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"
Oct 30 21:21:14.886901 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:14.886859    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"
Oct 30 21:21:15.169720 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:15.169679    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"]
Oct 30 21:21:15.171339 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:21:15.171307    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5355136_bad5_4326_8993_dc5e89781e90.slice/crio-ecf10506800b791333dd73475a087449aec45a84b842e9a934b54c0156f240ac WatchSource:0}: Error finding container ecf10506800b791333dd73475a087449aec45a84b842e9a934b54c0156f240ac: Status 404 returned error can't find the container with id ecf10506800b791333dd73475a087449aec45a84b842e9a934b54c0156f240ac
Oct 30 21:21:15.173326 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:15.173304    4948 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:21:15.396916 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:15.396878    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt" event={"ID":"c5355136-bad5-4326-8993-dc5e89781e90","Type":"ContainerStarted","Data":"ecf10506800b791333dd73475a087449aec45a84b842e9a934b54c0156f240ac"}
Oct 30 21:21:16.404214 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:16.404166    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt" event={"ID":"c5355136-bad5-4326-8993-dc5e89781e90","Type":"ContainerStarted","Data":"f486280a60991767c0b4bbe67f5c2b448c18d1f1aca207385636a0f45d03d334"}
Oct 30 21:21:16.404873 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:16.404310    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"
Oct 30 21:21:16.426173 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:16.426120    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt" podStartSLOduration=1.9619622049999998 podStartE2EDuration="2.426105257s" totalImagesPullingTime="464.143052ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:16.424575016 +0000 UTC m=+2544.244087005" watchObservedRunningTime="2026-10-30 21:21:16.426105257 +0000 UTC m=+2544.245617245"
Oct 30 21:21:21.473222 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:21.473181    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:21.913256 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:21.913213    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:22.118823 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:22.118784    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:22.415213 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:22.415183    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-llkzt"
Oct 30 21:21:22.470384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:22.470323    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"]
Oct 30 21:21:22.470664 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:22.470627    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx" podUID="4b4ad040-8011-4950-8362-9c6d0d7d42d5" containerName="maas-api" containerID="cri-o://f88cc96165185852589dc78e072c3fb35ec50306e8d181c7adc5a184e01ee0f7" gracePeriod=30
Oct 30 21:21:23.729260 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:23.729228    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 21:21:23.834521 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:23.834486    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4b4ad040-8011-4950-8362-9c6d0d7d42d5-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b4ad040-8011-4950-8362-9c6d0d7d42d5-openshift-service-ca\") pod \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\" (UID: \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\") "
Oct 30 21:21:23.834736 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:23.834558    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4b4ad040-8011-4950-8362-9c6d0d7d42d5-kube-api-access-s4wjs\" (UniqueName: \"kubernetes.io/projected/4b4ad040-8011-4950-8362-9c6d0d7d42d5-kube-api-access-s4wjs\") pod \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\" (UID: \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\") "
Oct 30 21:21:23.834736 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:23.834608    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4b4ad040-8011-4950-8362-9c6d0d7d42d5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4ad040-8011-4950-8362-9c6d0d7d42d5-metrics-certs\") pod \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\" (UID: \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\") "
Oct 30 21:21:23.834736 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:23.834678    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4b4ad040-8011-4950-8362-9c6d0d7d42d5-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b4ad040-8011-4950-8362-9c6d0d7d42d5-maas-api-tls\") pod \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\" (UID: \"4b4ad040-8011-4950-8362-9c6d0d7d42d5\") "
Oct 30 21:21:23.834994 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:23.834969    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b4ad040-8011-4950-8362-9c6d0d7d42d5-openshift-service-ca" pod "4b4ad040-8011-4950-8362-9c6d0d7d42d5" (UID: "4b4ad040-8011-4950-8362-9c6d0d7d42d5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:21:23.836957 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:23.836919    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b4ad040-8011-4950-8362-9c6d0d7d42d5-metrics-certs" pod "4b4ad040-8011-4950-8362-9c6d0d7d42d5" (UID: "4b4ad040-8011-4950-8362-9c6d0d7d42d5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:21:23.836957 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:23.836944    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b4ad040-8011-4950-8362-9c6d0d7d42d5-maas-api-tls" pod "4b4ad040-8011-4950-8362-9c6d0d7d42d5" (UID: "4b4ad040-8011-4950-8362-9c6d0d7d42d5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:21:23.837119 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:23.836931    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b4ad040-8011-4950-8362-9c6d0d7d42d5-kube-api-access-s4wjs" pod "4b4ad040-8011-4950-8362-9c6d0d7d42d5" (UID: "4b4ad040-8011-4950-8362-9c6d0d7d42d5"). InnerVolumeSpecName "kube-api-access-s4wjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:23.932942 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:21:23.932895    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:21:23.936556 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:23.936520    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4wjs\" (UniqueName: \"kubernetes.io/projected/4b4ad040-8011-4950-8362-9c6d0d7d42d5-kube-api-access-s4wjs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:23.936556 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:23.936555    4948 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4ad040-8011-4950-8362-9c6d0d7d42d5-metrics-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:23.936774 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:23.936567    4948 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b4ad040-8011-4950-8362-9c6d0d7d42d5-maas-api-tls\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:23.936774 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:23.936578    4948 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b4ad040-8011-4950-8362-9c6d0d7d42d5-openshift-service-ca\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:24.448906 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:24.448869    4948 generic.go:356] "Generic (PLEG): container finished" podID="4b4ad040-8011-4950-8362-9c6d0d7d42d5" containerID="f88cc96165185852589dc78e072c3fb35ec50306e8d181c7adc5a184e01ee0f7" exitCode=0
Oct 30 21:21:24.449095 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:24.448920    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"
Oct 30 21:21:24.449095 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:24.448956    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx" event={"ID":"4b4ad040-8011-4950-8362-9c6d0d7d42d5","Type":"ContainerDied","Data":"f88cc96165185852589dc78e072c3fb35ec50306e8d181c7adc5a184e01ee0f7"}
Oct 30 21:21:24.449095 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:24.449013    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx" event={"ID":"4b4ad040-8011-4950-8362-9c6d0d7d42d5","Type":"ContainerDied","Data":"799dd60e9b243922d17f6f5405d0291e3f754ef62a676f8daf406c4b6e2fe220"}
Oct 30 21:21:24.449095 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:24.449037    4948 scope.go:122] "RemoveContainer" containerID="f88cc96165185852589dc78e072c3fb35ec50306e8d181c7adc5a184e01ee0f7"
Oct 30 21:21:24.460217 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:24.460192    4948 scope.go:122] "RemoveContainer" containerID="f88cc96165185852589dc78e072c3fb35ec50306e8d181c7adc5a184e01ee0f7"
Oct 30 21:21:24.460729 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:21:24.460703    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f88cc96165185852589dc78e072c3fb35ec50306e8d181c7adc5a184e01ee0f7\": container with ID starting with f88cc96165185852589dc78e072c3fb35ec50306e8d181c7adc5a184e01ee0f7 not found: ID does not exist" containerID="f88cc96165185852589dc78e072c3fb35ec50306e8d181c7adc5a184e01ee0f7"
Oct 30 21:21:24.460832 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:24.460740    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f88cc96165185852589dc78e072c3fb35ec50306e8d181c7adc5a184e01ee0f7"} err="failed to get container status \"f88cc96165185852589dc78e072c3fb35ec50306e8d181c7adc5a184e01ee0f7\": rpc error: code = NotFound desc = could not find container \"f88cc96165185852589dc78e072c3fb35ec50306e8d181c7adc5a184e01ee0f7\": container with ID starting with f88cc96165185852589dc78e072c3fb35ec50306e8d181c7adc5a184e01ee0f7 not found: ID does not exist"
Oct 30 21:21:24.472303 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:24.472261    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"]
Oct 30 21:21:24.475485 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:24.475450    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6797b9d996-v2mlx"]
Oct 30 21:21:24.676863 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:24.676813    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:24.924858 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:24.924815    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:25.896507 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:25.896466    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"]
Oct 30 21:21:25.897062 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:25.897044    4948 cpu_manager.go:414] "containerMap: removing container" podUID="4b4ad040-8011-4950-8362-9c6d0d7d42d5" containerName="maas-api"
Oct 30 21:21:25.897111 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:25.897065    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4b4ad040-8011-4950-8362-9c6d0d7d42d5" containerName="maas-api"
Oct 30 21:21:25.897147 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:25.897140    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="4b4ad040-8011-4950-8362-9c6d0d7d42d5" containerName="maas-api"
Oct 30 21:21:25.901925 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:25.901896    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"
Oct 30 21:21:25.913245 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:25.913171    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-68a46da4\""
Oct 30 21:21:25.914230 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:25.914203    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-68a46da4-dockercfg-7gjq4\""
Oct 30 21:21:25.916851 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:25.916817    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"]
Oct 30 21:21:25.941779 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:25.941740    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:25.957673 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:25.957626    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"]
Oct 30 21:21:25.962412 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:25.962379    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"
Oct 30 21:21:25.970381 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:25.970333    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"]
Oct 30 21:21:26.066235 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.066195    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/001567d9-7852-474a-8bc9-38022eabbc1f-plugins-config-volume\") pod \"payload-processing-e2e-ait-68a46da4-7599549954-qprkg\" (UID: \"001567d9-7852-474a-8bc9-38022eabbc1f\") " pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"
Oct 30 21:21:26.066477 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.066280    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jntsm\" (UniqueName: \"kubernetes.io/projected/60473459-ff3a-4803-9640-32c6d56deb23-kube-api-access-jntsm\") pod \"payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh\" (UID: \"60473459-ff3a-4803-9640-32c6d56deb23\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"
Oct 30 21:21:26.066606 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.066579    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj75d\" (UniqueName: \"kubernetes.io/projected/001567d9-7852-474a-8bc9-38022eabbc1f-kube-api-access-mj75d\") pod \"payload-processing-e2e-ait-68a46da4-7599549954-qprkg\" (UID: \"001567d9-7852-474a-8bc9-38022eabbc1f\") " pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"
Oct 30 21:21:26.066650 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.066628    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60473459-ff3a-4803-9640-32c6d56deb23-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh\" (UID: \"60473459-ff3a-4803-9640-32c6d56deb23\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"
Oct 30 21:21:26.130736 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.130692    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"]
Oct 30 21:21:26.135218 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.135175    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:26.144903 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.144860    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-68a46da4-serving-cert\""
Oct 30 21:21:26.149156 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.149118    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"]
Oct 30 21:21:26.168323 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.168275    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jntsm\" (UniqueName: \"kubernetes.io/projected/60473459-ff3a-4803-9640-32c6d56deb23-kube-api-access-jntsm\") pod \"payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh\" (UID: \"60473459-ff3a-4803-9640-32c6d56deb23\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"
Oct 30 21:21:26.168540 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.168485    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj75d\" (UniqueName: \"kubernetes.io/projected/001567d9-7852-474a-8bc9-38022eabbc1f-kube-api-access-mj75d\") pod \"payload-processing-e2e-ait-68a46da4-7599549954-qprkg\" (UID: \"001567d9-7852-474a-8bc9-38022eabbc1f\") " pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"
Oct 30 21:21:26.168540 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.168526    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60473459-ff3a-4803-9640-32c6d56deb23-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh\" (UID: \"60473459-ff3a-4803-9640-32c6d56deb23\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"
Oct 30 21:21:26.168634 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.168594    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/001567d9-7852-474a-8bc9-38022eabbc1f-plugins-config-volume\") pod \"payload-processing-e2e-ait-68a46da4-7599549954-qprkg\" (UID: \"001567d9-7852-474a-8bc9-38022eabbc1f\") " pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"
Oct 30 21:21:26.169652 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.169626    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/001567d9-7852-474a-8bc9-38022eabbc1f-plugins-config-volume\") pod \"payload-processing-e2e-ait-68a46da4-7599549954-qprkg\" (UID: \"001567d9-7852-474a-8bc9-38022eabbc1f\") " pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"
Oct 30 21:21:26.170593 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.170565    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60473459-ff3a-4803-9640-32c6d56deb23-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh\" (UID: \"60473459-ff3a-4803-9640-32c6d56deb23\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"
Oct 30 21:21:26.178134 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.178100    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:26.182617 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.182580    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jntsm\" (UniqueName: \"kubernetes.io/projected/60473459-ff3a-4803-9640-32c6d56deb23-kube-api-access-jntsm\") pod \"payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh\" (UID: \"60473459-ff3a-4803-9640-32c6d56deb23\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"
Oct 30 21:21:26.182807 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.182589    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj75d\" (UniqueName: \"kubernetes.io/projected/001567d9-7852-474a-8bc9-38022eabbc1f-kube-api-access-mj75d\") pod \"payload-processing-e2e-ait-68a46da4-7599549954-qprkg\" (UID: \"001567d9-7852-474a-8bc9-38022eabbc1f\") " pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"
Oct 30 21:21:26.216311 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.216261    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"
Oct 30 21:21:26.286388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.282037    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78d25d13-aa85-4321-8767-5a6b7b4a9f93-metrics-certs\") pod \"maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr\" (UID: \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:26.286388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.282155    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfph4\" (UniqueName: \"kubernetes.io/projected/78d25d13-aa85-4321-8767-5a6b7b4a9f93-kube-api-access-rfph4\") pod \"maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr\" (UID: \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:26.286388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.282352    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78d25d13-aa85-4321-8767-5a6b7b4a9f93-openshift-service-ca\") pod \"maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr\" (UID: \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:26.286388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.282451    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78d25d13-aa85-4321-8767-5a6b7b4a9f93-maas-api-tls\") pod \"maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr\" (UID: \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:26.286388 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.282732    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"
Oct 30 21:21:26.310779 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.310558    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4b4ad040-8011-4950-8362-9c6d0d7d42d5" path="/var/lib/kubelet/pods/4b4ad040-8011-4950-8362-9c6d0d7d42d5/volumes"
Oct 30 21:21:26.379000 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.378512    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:26.384017 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.383981    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78d25d13-aa85-4321-8767-5a6b7b4a9f93-metrics-certs\") pod \"maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr\" (UID: \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:26.384181 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.384036    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfph4\" (UniqueName: \"kubernetes.io/projected/78d25d13-aa85-4321-8767-5a6b7b4a9f93-kube-api-access-rfph4\") pod \"maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr\" (UID: \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:26.384181 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.384098    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78d25d13-aa85-4321-8767-5a6b7b4a9f93-openshift-service-ca\") pod \"maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr\" (UID: \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:26.384181 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.384147    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78d25d13-aa85-4321-8767-5a6b7b4a9f93-maas-api-tls\") pod \"maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr\" (UID: \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:26.385723 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.385691    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78d25d13-aa85-4321-8767-5a6b7b4a9f93-openshift-service-ca\") pod \"maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr\" (UID: \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:26.390927 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.390895    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78d25d13-aa85-4321-8767-5a6b7b4a9f93-metrics-certs\") pod \"maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr\" (UID: \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:26.392950 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.392916    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78d25d13-aa85-4321-8767-5a6b7b4a9f93-maas-api-tls\") pod \"maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr\" (UID: \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:26.399461 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.399345    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfph4\" (UniqueName: \"kubernetes.io/projected/78d25d13-aa85-4321-8767-5a6b7b4a9f93-kube-api-access-rfph4\") pod \"maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr\" (UID: \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:26.461083 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.461048    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:26.556734 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.556699    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"]
Oct 30 21:21:26.563079 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:21:26.563045    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60473459_ff3a_4803_9640_32c6d56deb23.slice/crio-5701177d631f98387b8496b2e97cbffbae7e435c9f27d6447c389c57aa4ff206 WatchSource:0}: Error finding container 5701177d631f98387b8496b2e97cbffbae7e435c9f27d6447c389c57aa4ff206: Status 404 returned error can't find the container with id 5701177d631f98387b8496b2e97cbffbae7e435c9f27d6447c389c57aa4ff206
Oct 30 21:21:26.611344 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.611313    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"]
Oct 30 21:21:26.614036 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:21:26.613991    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001567d9_7852_474a_8bc9_38022eabbc1f.slice/crio-55214ad114e6a041796ade4786a78e0566f2a095a1dcc5abb9a712a3be429b9b WatchSource:0}: Error finding container 55214ad114e6a041796ade4786a78e0566f2a095a1dcc5abb9a712a3be429b9b: Status 404 returned error can't find the container with id 55214ad114e6a041796ade4786a78e0566f2a095a1dcc5abb9a712a3be429b9b
Oct 30 21:21:26.747038 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:26.746989    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"]
Oct 30 21:21:26.748845 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:21:26.748811    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78d25d13_aa85_4321_8767_5a6b7b4a9f93.slice/crio-051726a7d098d45a77867f974d38a2f5274cf279b50c09ee93ced40dac3a56fa WatchSource:0}: Error finding container 051726a7d098d45a77867f974d38a2f5274cf279b50c09ee93ced40dac3a56fa: Status 404 returned error can't find the container with id 051726a7d098d45a77867f974d38a2f5274cf279b50c09ee93ced40dac3a56fa
Oct 30 21:21:27.359119 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:27.359076    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:27.469755 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:27.469645    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg" event={"ID":"001567d9-7852-474a-8bc9-38022eabbc1f","Type":"ContainerStarted","Data":"aaec08fdabba0d970c23a59587e30e2346c8bff9b3e88026561ef7dd15942874"}
Oct 30 21:21:27.469755 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:27.469715    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg" event={"ID":"001567d9-7852-474a-8bc9-38022eabbc1f","Type":"ContainerStarted","Data":"55214ad114e6a041796ade4786a78e0566f2a095a1dcc5abb9a712a3be429b9b"}
Oct 30 21:21:27.470011 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:27.469883    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"
Oct 30 21:21:27.471880 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:27.471845    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh" event={"ID":"60473459-ff3a-4803-9640-32c6d56deb23","Type":"ContainerStarted","Data":"40b4816d94a0d4498f798fa1ed1a31bab62d3a2bf597838310598706e3985276"}
Oct 30 21:21:27.472088 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:27.471916    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"
Oct 30 21:21:27.472088 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:27.471940    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh" event={"ID":"60473459-ff3a-4803-9640-32c6d56deb23","Type":"ContainerStarted","Data":"5701177d631f98387b8496b2e97cbffbae7e435c9f27d6447c389c57aa4ff206"}
Oct 30 21:21:27.473784 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:27.473745    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr" event={"ID":"78d25d13-aa85-4321-8767-5a6b7b4a9f93","Type":"ContainerStarted","Data":"41d8d4fe322e604220a5ad1c2236e32f89470b7b278548325ee2ee14ce886887"}
Oct 30 21:21:27.473940 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:27.473817    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr" event={"ID":"78d25d13-aa85-4321-8767-5a6b7b4a9f93","Type":"ContainerStarted","Data":"051726a7d098d45a77867f974d38a2f5274cf279b50c09ee93ced40dac3a56fa"}
Oct 30 21:21:27.473940 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:27.473851    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:27.490877 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:27.490702    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg" podStartSLOduration=2.490681504 podStartE2EDuration="2.490681504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:27.49021327 +0000 UTC m=+2555.309725259" watchObservedRunningTime="2026-10-30 21:21:27.490681504 +0000 UTC m=+2555.310193493"
Oct 30 21:21:27.511648 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:27.511581    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr" podStartSLOduration=1.086381958 podStartE2EDuration="1.511559747s" totalImagesPullingTime="425.177789ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:27.510771068 +0000 UTC m=+2555.330283057" watchObservedRunningTime="2026-10-30 21:21:27.511559747 +0000 UTC m=+2555.331071735"
Oct 30 21:21:27.530419 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:27.530335    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh" podStartSLOduration=2.530319123 podStartE2EDuration="2.530319123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:27.529904449 +0000 UTC m=+2555.349416442" watchObservedRunningTime="2026-10-30 21:21:27.530319123 +0000 UTC m=+2555.349831163"
Oct 30 21:21:28.081547 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:28.081500    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:28.792284 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:28.792247    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:29.598336 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:29.598295    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:30.290898 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:30.290858    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:31.325542 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:31.325505    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:31.692510 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:31.692474    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:32.440101 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:32.440060    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:33.088044 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:33.088005    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:33.486447 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:33.486325    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:33.888642 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:33.888587    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:34.669375 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:34.669324    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:35.569562 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:35.569523    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:36.278295 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:36.278257    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:37.345894 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:37.345852    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:37.689900 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:37.689808    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:38.399990 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:38.399951    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:38.483031 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:38.483000    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"
Oct 30 21:21:38.483250 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:38.483090    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"
Oct 30 21:21:39.149208 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:39.149171    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:39.903970 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:39.903921    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:40.978101 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:40.978053    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:41.684087 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:41.684049    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:42.386056 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:42.386022    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:43.033631 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:43.033572    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:43.268377 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:43.268326    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:43.903260 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:43.903219    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:44.788517 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:44.788472    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:45.349616 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:45.349573    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:45.598124 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:45.598091    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:46.300713 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:46.300674    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:47.031200 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:47.031156    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:47.968173 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:47.968133    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:48.811106 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:48.811057    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:49.492605 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:49.492561    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:50.198714 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:50.198676    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:50.338314 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:50.338273    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"]
Oct 30 21:21:50.353318 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:50.353280    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"]
Oct 30 21:21:50.514964 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:50.514871    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:50.639962 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:50.639907    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"]
Oct 30 21:21:50.640620 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:50.640579    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr" podUID="78d25d13-aa85-4321-8767-5a6b7b4a9f93" containerName="maas-api" containerID="cri-o://41d8d4fe322e604220a5ad1c2236e32f89470b7b278548325ee2ee14ce886887" gracePeriod=30
Oct 30 21:21:50.716209 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:50.716176    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:50.915536 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:50.915495    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:50.964855 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:50.964821    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:51.091940 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.091899    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/78d25d13-aa85-4321-8767-5a6b7b4a9f93-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78d25d13-aa85-4321-8767-5a6b7b4a9f93-maas-api-tls\") pod \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\" (UID: \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\") "
Oct 30 21:21:51.092148 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.091957    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/78d25d13-aa85-4321-8767-5a6b7b4a9f93-metrics-certs\" (UniqueName: \"kubernetes.io/secret/78d25d13-aa85-4321-8767-5a6b7b4a9f93-metrics-certs\") pod \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\" (UID: \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\") "
Oct 30 21:21:51.092148 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.092007    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/78d25d13-aa85-4321-8767-5a6b7b4a9f93-kube-api-access-rfph4\" (UniqueName: \"kubernetes.io/projected/78d25d13-aa85-4321-8767-5a6b7b4a9f93-kube-api-access-rfph4\") pod \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\" (UID: \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\") "
Oct 30 21:21:51.092238 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.092198    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/78d25d13-aa85-4321-8767-5a6b7b4a9f93-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78d25d13-aa85-4321-8767-5a6b7b4a9f93-openshift-service-ca\") pod \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\" (UID: \"78d25d13-aa85-4321-8767-5a6b7b4a9f93\") "
Oct 30 21:21:51.092672 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.092645    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78d25d13-aa85-4321-8767-5a6b7b4a9f93-openshift-service-ca" pod "78d25d13-aa85-4321-8767-5a6b7b4a9f93" (UID: "78d25d13-aa85-4321-8767-5a6b7b4a9f93"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:21:51.094428 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.094394    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78d25d13-aa85-4321-8767-5a6b7b4a9f93-metrics-certs" pod "78d25d13-aa85-4321-8767-5a6b7b4a9f93" (UID: "78d25d13-aa85-4321-8767-5a6b7b4a9f93"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:21:51.094557 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.094492    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78d25d13-aa85-4321-8767-5a6b7b4a9f93-maas-api-tls" pod "78d25d13-aa85-4321-8767-5a6b7b4a9f93" (UID: "78d25d13-aa85-4321-8767-5a6b7b4a9f93"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:21:51.094557 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.094535    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78d25d13-aa85-4321-8767-5a6b7b4a9f93-kube-api-access-rfph4" pod "78d25d13-aa85-4321-8767-5a6b7b4a9f93" (UID: "78d25d13-aa85-4321-8767-5a6b7b4a9f93"). InnerVolumeSpecName "kube-api-access-rfph4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:51.118649 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.117871    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:51.193936 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.193894    4948 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78d25d13-aa85-4321-8767-5a6b7b4a9f93-openshift-service-ca\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:51.193936 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.193930    4948 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78d25d13-aa85-4321-8767-5a6b7b4a9f93-maas-api-tls\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:51.193936 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.193945    4948 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78d25d13-aa85-4321-8767-5a6b7b4a9f93-metrics-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:51.194219 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.193958    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfph4\" (UniqueName: \"kubernetes.io/projected/78d25d13-aa85-4321-8767-5a6b7b4a9f93-kube-api-access-rfph4\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:51.644525 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.644483    4948 generic.go:356] "Generic (PLEG): container finished" podID="78d25d13-aa85-4321-8767-5a6b7b4a9f93" containerID="41d8d4fe322e604220a5ad1c2236e32f89470b7b278548325ee2ee14ce886887" exitCode=0
Oct 30 21:21:51.645010 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.644545    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"
Oct 30 21:21:51.645010 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.644572    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr" event={"ID":"78d25d13-aa85-4321-8767-5a6b7b4a9f93","Type":"ContainerDied","Data":"41d8d4fe322e604220a5ad1c2236e32f89470b7b278548325ee2ee14ce886887"}
Oct 30 21:21:51.645010 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.644640    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr" event={"ID":"78d25d13-aa85-4321-8767-5a6b7b4a9f93","Type":"ContainerDied","Data":"051726a7d098d45a77867f974d38a2f5274cf279b50c09ee93ced40dac3a56fa"}
Oct 30 21:21:51.645010 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.644665    4948 scope.go:122] "RemoveContainer" containerID="41d8d4fe322e604220a5ad1c2236e32f89470b7b278548325ee2ee14ce886887"
Oct 30 21:21:51.655177 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.655154    4948 scope.go:122] "RemoveContainer" containerID="41d8d4fe322e604220a5ad1c2236e32f89470b7b278548325ee2ee14ce886887"
Oct 30 21:21:51.655562 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:21:51.655542    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41d8d4fe322e604220a5ad1c2236e32f89470b7b278548325ee2ee14ce886887\": container with ID starting with 41d8d4fe322e604220a5ad1c2236e32f89470b7b278548325ee2ee14ce886887 not found: ID does not exist" containerID="41d8d4fe322e604220a5ad1c2236e32f89470b7b278548325ee2ee14ce886887"
Oct 30 21:21:51.655622 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.655574    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41d8d4fe322e604220a5ad1c2236e32f89470b7b278548325ee2ee14ce886887"} err="failed to get container status \"41d8d4fe322e604220a5ad1c2236e32f89470b7b278548325ee2ee14ce886887\": rpc error: code = NotFound desc = could not find container \"41d8d4fe322e604220a5ad1c2236e32f89470b7b278548325ee2ee14ce886887\": container with ID starting with 41d8d4fe322e604220a5ad1c2236e32f89470b7b278548325ee2ee14ce886887 not found: ID does not exist"
Oct 30 21:21:51.667024 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.666978    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"]
Oct 30 21:21:51.673411 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:51.673371    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-68a46da4-cd7c9bf85-cwplr"]
Oct 30 21:21:52.297069 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:52.297028    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="78d25d13-aa85-4321-8767-5a6b7b4a9f93" path="/var/lib/kubelet/pods/78d25d13-aa85-4321-8767-5a6b7b4a9f93/volumes"
Oct 30 21:21:53.929946 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:21:53.929903    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:21:55.338752 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.338708    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg" podUID="001567d9-7852-474a-8bc9-38022eabbc1f" containerName="payload-processing" containerID="cri-o://aaec08fdabba0d970c23a59587e30e2346c8bff9b3e88026561ef7dd15942874" gracePeriod=25
Oct 30 21:21:55.354336 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.354285    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh" podUID="60473459-ff3a-4803-9640-32c6d56deb23" containerName="payload-pre-processing" containerID="cri-o://40b4816d94a0d4498f798fa1ed1a31bab62d3a2bf597838310598706e3985276" gracePeriod=25
Oct 30 21:21:55.623711 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.623676    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"
Oct 30 21:21:55.641040 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.641004    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"
Oct 30 21:21:55.671840 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.671798    4948 generic.go:356] "Generic (PLEG): container finished" podID="60473459-ff3a-4803-9640-32c6d56deb23" containerID="40b4816d94a0d4498f798fa1ed1a31bab62d3a2bf597838310598706e3985276" exitCode=0
Oct 30 21:21:55.672037 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.671894    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"
Oct 30 21:21:55.672037 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.671928    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh" event={"ID":"60473459-ff3a-4803-9640-32c6d56deb23","Type":"ContainerDied","Data":"40b4816d94a0d4498f798fa1ed1a31bab62d3a2bf597838310598706e3985276"}
Oct 30 21:21:55.672037 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.671978    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh" event={"ID":"60473459-ff3a-4803-9640-32c6d56deb23","Type":"ContainerDied","Data":"5701177d631f98387b8496b2e97cbffbae7e435c9f27d6447c389c57aa4ff206"}
Oct 30 21:21:55.672037 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.672015    4948 scope.go:122] "RemoveContainer" containerID="40b4816d94a0d4498f798fa1ed1a31bab62d3a2bf597838310598706e3985276"
Oct 30 21:21:55.674151 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.674124    4948 generic.go:356] "Generic (PLEG): container finished" podID="001567d9-7852-474a-8bc9-38022eabbc1f" containerID="aaec08fdabba0d970c23a59587e30e2346c8bff9b3e88026561ef7dd15942874" exitCode=0
Oct 30 21:21:55.674275 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.674201    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg" event={"ID":"001567d9-7852-474a-8bc9-38022eabbc1f","Type":"ContainerDied","Data":"aaec08fdabba0d970c23a59587e30e2346c8bff9b3e88026561ef7dd15942874"}
Oct 30 21:21:55.674275 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.674238    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg" event={"ID":"001567d9-7852-474a-8bc9-38022eabbc1f","Type":"ContainerDied","Data":"55214ad114e6a041796ade4786a78e0566f2a095a1dcc5abb9a712a3be429b9b"}
Oct 30 21:21:55.674459 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.674298    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"
Oct 30 21:21:55.683705 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.683673    4948 scope.go:122] "RemoveContainer" containerID="40b4816d94a0d4498f798fa1ed1a31bab62d3a2bf597838310598706e3985276"
Oct 30 21:21:55.684134 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:21:55.684110    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40b4816d94a0d4498f798fa1ed1a31bab62d3a2bf597838310598706e3985276\": container with ID starting with 40b4816d94a0d4498f798fa1ed1a31bab62d3a2bf597838310598706e3985276 not found: ID does not exist" containerID="40b4816d94a0d4498f798fa1ed1a31bab62d3a2bf597838310598706e3985276"
Oct 30 21:21:55.684227 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.684146    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40b4816d94a0d4498f798fa1ed1a31bab62d3a2bf597838310598706e3985276"} err="failed to get container status \"40b4816d94a0d4498f798fa1ed1a31bab62d3a2bf597838310598706e3985276\": rpc error: code = NotFound desc = could not find container \"40b4816d94a0d4498f798fa1ed1a31bab62d3a2bf597838310598706e3985276\": container with ID starting with 40b4816d94a0d4498f798fa1ed1a31bab62d3a2bf597838310598706e3985276 not found: ID does not exist"
Oct 30 21:21:55.684227 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.684167    4948 scope.go:122] "RemoveContainer" containerID="aaec08fdabba0d970c23a59587e30e2346c8bff9b3e88026561ef7dd15942874"
Oct 30 21:21:55.693646 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.693619    4948 scope.go:122] "RemoveContainer" containerID="aaec08fdabba0d970c23a59587e30e2346c8bff9b3e88026561ef7dd15942874"
Oct 30 21:21:55.694016 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:21:55.693995    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaec08fdabba0d970c23a59587e30e2346c8bff9b3e88026561ef7dd15942874\": container with ID starting with aaec08fdabba0d970c23a59587e30e2346c8bff9b3e88026561ef7dd15942874 not found: ID does not exist" containerID="aaec08fdabba0d970c23a59587e30e2346c8bff9b3e88026561ef7dd15942874"
Oct 30 21:21:55.694103 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.694030    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaec08fdabba0d970c23a59587e30e2346c8bff9b3e88026561ef7dd15942874"} err="failed to get container status \"aaec08fdabba0d970c23a59587e30e2346c8bff9b3e88026561ef7dd15942874\": rpc error: code = NotFound desc = could not find container \"aaec08fdabba0d970c23a59587e30e2346c8bff9b3e88026561ef7dd15942874\": container with ID starting with aaec08fdabba0d970c23a59587e30e2346c8bff9b3e88026561ef7dd15942874 not found: ID does not exist"
Oct 30 21:21:55.742014 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.741974    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/60473459-ff3a-4803-9640-32c6d56deb23-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60473459-ff3a-4803-9640-32c6d56deb23-plugins-config-volume\") pod \"60473459-ff3a-4803-9640-32c6d56deb23\" (UID: \"60473459-ff3a-4803-9640-32c6d56deb23\") "
Oct 30 21:21:55.742014 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.742019    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/60473459-ff3a-4803-9640-32c6d56deb23-kube-api-access-jntsm\" (UniqueName: \"kubernetes.io/projected/60473459-ff3a-4803-9640-32c6d56deb23-kube-api-access-jntsm\") pod \"60473459-ff3a-4803-9640-32c6d56deb23\" (UID: \"60473459-ff3a-4803-9640-32c6d56deb23\") "
Oct 30 21:21:55.742303 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.742074    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/001567d9-7852-474a-8bc9-38022eabbc1f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/001567d9-7852-474a-8bc9-38022eabbc1f-plugins-config-volume\") pod \"001567d9-7852-474a-8bc9-38022eabbc1f\" (UID: \"001567d9-7852-474a-8bc9-38022eabbc1f\") "
Oct 30 21:21:55.742303 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.742220    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/001567d9-7852-474a-8bc9-38022eabbc1f-kube-api-access-mj75d\" (UniqueName: \"kubernetes.io/projected/001567d9-7852-474a-8bc9-38022eabbc1f-kube-api-access-mj75d\") pod \"001567d9-7852-474a-8bc9-38022eabbc1f\" (UID: \"001567d9-7852-474a-8bc9-38022eabbc1f\") "
Oct 30 21:21:55.742457 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.742425    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60473459-ff3a-4803-9640-32c6d56deb23-plugins-config-volume" pod "60473459-ff3a-4803-9640-32c6d56deb23" (UID: "60473459-ff3a-4803-9640-32c6d56deb23"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:21:55.742539 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.742516    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/001567d9-7852-474a-8bc9-38022eabbc1f-plugins-config-volume" pod "001567d9-7852-474a-8bc9-38022eabbc1f" (UID: "001567d9-7852-474a-8bc9-38022eabbc1f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:21:55.742635 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.742622    4948 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60473459-ff3a-4803-9640-32c6d56deb23-plugins-config-volume\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:55.742676 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.742639    4948 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/001567d9-7852-474a-8bc9-38022eabbc1f-plugins-config-volume\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:55.744354 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.744324    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/001567d9-7852-474a-8bc9-38022eabbc1f-kube-api-access-mj75d" pod "001567d9-7852-474a-8bc9-38022eabbc1f" (UID: "001567d9-7852-474a-8bc9-38022eabbc1f"). InnerVolumeSpecName "kube-api-access-mj75d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:55.744458 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.744336    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60473459-ff3a-4803-9640-32c6d56deb23-kube-api-access-jntsm" pod "60473459-ff3a-4803-9640-32c6d56deb23" (UID: "60473459-ff3a-4803-9640-32c6d56deb23"). InnerVolumeSpecName "kube-api-access-jntsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:55.843613 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.843571    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mj75d\" (UniqueName: \"kubernetes.io/projected/001567d9-7852-474a-8bc9-38022eabbc1f-kube-api-access-mj75d\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:55.843613 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.843607    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jntsm\" (UniqueName: \"kubernetes.io/projected/60473459-ff3a-4803-9640-32c6d56deb23-kube-api-access-jntsm\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:55.997612 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:55.997565    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"]
Oct 30 21:21:56.001608 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:56.001574    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68a46da4-6d6ffb6fbc-rpksh"]
Oct 30 21:21:56.013438 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:56.013395    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"]
Oct 30 21:21:56.017505 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:56.017468    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-68a46da4-7599549954-qprkg"]
Oct 30 21:21:56.293496 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:56.293413    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="001567d9-7852-474a-8bc9-38022eabbc1f" path="/var/lib/kubelet/pods/001567d9-7852-474a-8bc9-38022eabbc1f/volumes"
Oct 30 21:21:56.293834 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:56.293821    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="60473459-ff3a-4803-9640-32c6d56deb23" path="/var/lib/kubelet/pods/60473459-ff3a-4803-9640-32c6d56deb23/volumes"
Oct 30 21:21:56.811121 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:56.809173    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:58.088608 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.088574    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:58.508032 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.507925    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"]
Oct 30 21:21:58.508520 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.508497    4948 cpu_manager.go:414] "containerMap: removing container" podUID="60473459-ff3a-4803-9640-32c6d56deb23" containerName="payload-pre-processing"
Oct 30 21:21:58.508644 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.508521    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="60473459-ff3a-4803-9640-32c6d56deb23" containerName="payload-pre-processing"
Oct 30 21:21:58.508644 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.508556    4948 cpu_manager.go:414] "containerMap: removing container" podUID="001567d9-7852-474a-8bc9-38022eabbc1f" containerName="payload-processing"
Oct 30 21:21:58.508644 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.508564    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="001567d9-7852-474a-8bc9-38022eabbc1f" containerName="payload-processing"
Oct 30 21:21:58.508644 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.508583    4948 cpu_manager.go:414] "containerMap: removing container" podUID="78d25d13-aa85-4321-8767-5a6b7b4a9f93" containerName="maas-api"
Oct 30 21:21:58.508644 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.508592    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="78d25d13-aa85-4321-8767-5a6b7b4a9f93" containerName="maas-api"
Oct 30 21:21:58.508896 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.508715    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="001567d9-7852-474a-8bc9-38022eabbc1f" containerName="payload-processing"
Oct 30 21:21:58.508896 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.508731    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="78d25d13-aa85-4321-8767-5a6b7b4a9f93" containerName="maas-api"
Oct 30 21:21:58.508896 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.508750    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="60473459-ff3a-4803-9640-32c6d56deb23" containerName="payload-pre-processing"
Oct 30 21:21:58.513959 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.513921    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.560405 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.559745    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"]
Oct 30 21:21:58.567211 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.567168    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-authcfg-http-d8974d-openshift-default-dockercfg-2jcvr\""
Oct 30 21:21:58.671086 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.671032    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-podinfo\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.671320 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.671124    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-workload-certs\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.671320 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.671242    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-envoy\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.671320 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.671280    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-credential-socket\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.671545 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.671323    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-workload-socket\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.671545 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.671511    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0961cc62-f5c3-4405-a07c-58f48c84402a-istiod-ca-cert\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.671647 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.671559    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-token\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.671706 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.671683    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm799\" (UniqueName: \"kubernetes.io/projected/0961cc62-f5c3-4405-a07c-58f48c84402a-kube-api-access-cm799\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.671760 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.671721    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-data\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.692491 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.692450    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:58.772995 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.772887    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0961cc62-f5c3-4405-a07c-58f48c84402a-istiod-ca-cert\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.772995 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.772946    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-token\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.773268 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.772999    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm799\" (UniqueName: \"kubernetes.io/projected/0961cc62-f5c3-4405-a07c-58f48c84402a-kube-api-access-cm799\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.773268 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.773025    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-data\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.773268 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.773059    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-podinfo\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.773268 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.773112    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-workload-certs\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.773268 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.773160    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-envoy\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.773268 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.773186    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-credential-socket\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.773268 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.773228    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-workload-socket\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.773686 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.773583    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-data\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.773762 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.773742    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-workload-certs\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.773870 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.773845    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-credential-socket\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.773909 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.773870    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0961cc62-f5c3-4405-a07c-58f48c84402a-istiod-ca-cert\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.773909 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.773887    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-workload-socket\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.775784 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.775752    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-envoy\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.776744 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.776721    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-podinfo\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.786828 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.786790    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-token\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.786991 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.786869    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm799\" (UniqueName: \"kubernetes.io/projected/0961cc62-f5c3-4405-a07c-58f48c84402a-kube-api-access-cm799\") pod \"e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") " pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.829955 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.829909    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:21:58.915599 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:58.915457    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:59.130410 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:59.130379    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"]
Oct 30 21:21:59.132558 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:21:59.132520    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0961cc62_f5c3_4405_a07c_58f48c84402a.slice/crio-2fe20872959cb97cc3086dfcec604a08bf9abe0175ec278641702cc4064f1854 WatchSource:0}: Error finding container 2fe20872959cb97cc3086dfcec604a08bf9abe0175ec278641702cc4064f1854: Status 404 returned error can't find the container with id 2fe20872959cb97cc3086dfcec604a08bf9abe0175ec278641702cc4064f1854
Oct 30 21:21:59.134996 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:59.134960    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:21:59.135065 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:59.135036    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:21:59.135116 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:59.135065    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:21:59.700472 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:59.700423    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9" event={"ID":"0961cc62-f5c3-4405-a07c-58f48c84402a","Type":"ContainerStarted","Data":"9ac839e2f844ac0d2f3574d8f78a5a348f2363d2ba145f9d6b77a989e65b9a1c"}
Oct 30 21:21:59.700658 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:59.700490    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9" event={"ID":"0961cc62-f5c3-4405-a07c-58f48c84402a","Type":"ContainerStarted","Data":"2fe20872959cb97cc3086dfcec604a08bf9abe0175ec278641702cc4064f1854"}
Oct 30 21:21:59.725664 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:59.725601    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9" podStartSLOduration=1.725583539 podStartE2EDuration="1.725583539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:59.724094801 +0000 UTC m=+2587.543606790" watchObservedRunningTime="2026-10-30 21:21:59.725583539 +0000 UTC m=+2587.545095527"
Oct 30 21:21:59.831171 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:21:59.831111    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:22:00.837436 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:00.837403    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:22:01.711623 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:01.711587    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:22:01.712871 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:01.712844    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:22:02.134679 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:02.134641    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:02.350524 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:02.350485    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:03.309009 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:03.308967    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:03.604790 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:03.604699    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:04.287061 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:04.287020    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:05.092268 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:05.092222    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:05.891868 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:05.891823    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:06.780770 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:06.780722    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:07.512940 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:07.512904    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:08.309959 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:08.309921    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:09.195348 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:09.195302    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:09.971082 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:09.971042    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:10.813639 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:10.813605    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:11.718807 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:11.718750    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:12.553130 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:12.553023    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:13.399911 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:13.399872    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:14.109163 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:14.109121    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:14.869845 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:14.869806    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:15.783232 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:15.783127    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:15.838018 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:15.837982    4948 generic.go:356] "Generic (PLEG): container finished" podID="0961cc62-f5c3-4405-a07c-58f48c84402a" containerID="9ac839e2f844ac0d2f3574d8f78a5a348f2363d2ba145f9d6b77a989e65b9a1c" exitCode=0
Oct 30 21:22:15.838226 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:15.838061    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9" event={"ID":"0961cc62-f5c3-4405-a07c-58f48c84402a","Type":"ContainerDied","Data":"9ac839e2f844ac0d2f3574d8f78a5a348f2363d2ba145f9d6b77a989e65b9a1c"}
Oct 30 21:22:15.838544 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:15.838528    4948 scope.go:122] "RemoveContainer" containerID="9ac839e2f844ac0d2f3574d8f78a5a348f2363d2ba145f9d6b77a989e65b9a1c"
Oct 30 21:22:15.839992 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:15.839965    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:22:15.840060 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:15.840043    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:22:15.840096 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:15.840079    4948 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 30 21:22:16.570384 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:16.567175    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:16.711826 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:16.711786    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:22:16.845907 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:16.845866    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9" event={"ID":"0961cc62-f5c3-4405-a07c-58f48c84402a","Type":"ContainerStarted","Data":"82fd6b7940676387d8bc7ad2df0b1c1657656124a6fca834c0611b770fb322eb"}
Oct 30 21:22:17.036563 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:17.036526    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:17.370386 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:17.369801    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:17.831304 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:17.831180    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:22:17.832441 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:17.832409    4948 patch_prober.go:29] interesting pod/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 21:22:17.832564 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:17.832477    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9" podUID="0961cc62-f5c3-4405-a07c-58f48c84402a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 21:22:18.188456 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:18.188347    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:18.831375 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:18.831322    4948 patch_prober.go:29] interesting pod/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 21:22:18.831834 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:18.831418    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9" podUID="0961cc62-f5c3-4405-a07c-58f48c84402a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 21:22:19.031300 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:19.031243    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:19.806155 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:19.806098    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:19.831350 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:19.831315    4948 patch_prober.go:29] interesting pod/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 21:22:19.831525 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:19.831410    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9" podUID="0961cc62-f5c3-4405-a07c-58f48c84402a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 21:22:20.608151 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:20.608106    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:20.831690 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:20.831646    4948 patch_prober.go:29] interesting pod/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 21:22:20.832221 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:20.831721    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9" podUID="0961cc62-f5c3-4405-a07c-58f48c84402a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 21:22:21.504027 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:21.503970    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:21.831053 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:21.830952    4948 patch_prober.go:29] interesting pod/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 21:22:21.831053 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:21.831015    4948 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9" podUID="0961cc62-f5c3-4405-a07c-58f48c84402a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 21:22:22.280126 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:22.280088    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:22.835838 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:22.835806    4948 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:22:22.836172 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:22.836145    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:22:22.837042 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:22.837025    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:22:23.089271 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:23.089172    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:23.797343 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:23.797303    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:23.929476 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:22:23.929433    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:22:24.496450 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:24.496413    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:25.192852 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:25.192815    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:25.899110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:25.899072    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:26.597261 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:26.597217    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:27.387219 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:27.387177    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:28.115590 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:28.115542    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:28.856893 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:28.856854    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:29.593639 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:29.593604    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:30.297065 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:30.297027    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:30.989123 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:30.989074    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:31.696443 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:31.696405    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:32.423059 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:32.423019    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:33.188486 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:33.188451    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:33.898488 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:33.898450    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:34.603866 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:34.603827    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:35.395734 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:35.395695    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:36.097433 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:36.097350    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:36.803937 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:36.803899    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:37.484207 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:37.484173    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:38.192262 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:38.192226    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:38.902613 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:38.902573    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:39.704174 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:39.704133    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:40.402800 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:40.402766    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:41.119662 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:41.119623    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:41.871016 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:41.870964    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:42.665871 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:42.665828    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:43.377328 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:43.377284    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:44.086936 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:44.086898    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:44.909426 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:44.909390    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:45.471845 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:45.471799    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:45.671737 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:45.671700    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:46.289768 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:46.289728    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:47.129808 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:47.129765    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:47.778190 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:47.778151    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:48.496212 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:48.496178    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:49.188889 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:49.188837    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:49.998255 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:49.998220    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:50.706639 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:50.706597    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:51.413325 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:51.413290    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:52.372535 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:52.372501    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:53.187602 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:53.187552    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:53.884446 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:53.884401    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:53.929225 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:22:53.929185    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:22:54.898107 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:54.898052    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:55.311484 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:55.311383    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:56.013757 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:56.013705    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:56.816775 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:56.816740    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:57.605546 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:57.605508    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:58.395610 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:58.395568    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:59.199814 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:59.199763    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:59.892702 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:22:59.892664    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:00.601450 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:00.601412    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:01.392944 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:01.392910    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:01.593090 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:01.593048    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:02.197746 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:02.197706    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:02.933128 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:02.933085    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:03.746855 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:03.746757    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:03.994569 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:03.994532    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:04.498615 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:04.498574    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:05.199195 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:05.199154    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:05.902970 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:05.902890    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:06.653120 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:06.653077    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:07.538942 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:07.538888    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:08.291636 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:08.291599    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:09.033350 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:09.033302    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:09.691768 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:09.691722    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:10.431134 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:10.431093    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:11.201162 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:11.201088    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:11.902399 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:11.902345    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:12.596165 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:12.596131    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:13.367635 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:13.367603    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:14.085457 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:14.085421    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:14.823036 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:14.822995    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:15.598952 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:15.598910    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:16.515523 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:16.515483    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:17.372241 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:17.372202    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:18.203248 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:18.203210    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:18.887298 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:18.887262    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:19.719016 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:19.718948    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:20.489616 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:20.489578    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:21.189039 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:21.188997    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:21.889645 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:21.889605    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:22.598305 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:22.598265    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:23.302629 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:23.302586    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:23.951173 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:23:23.951128    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:23:23.988943 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:23.988908    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:24.787590 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:24.787546    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:25.593023 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:25.592984    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:26.297463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:26.297423    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:27.002047 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:27.001984    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:27.701307 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:27.701266    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:28.470935 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:28.470899    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:29.301124 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:29.301082    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:29.994131 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:29.994087    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:30.693333 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:30.693299    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:31.494961 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:31.494914    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:32.194770 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:32.194730    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:32.904606 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:32.904566    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:33.593403 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:33.593337    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:34.298305 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:34.298263    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:35.102720 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:35.102679    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:35.878145 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:35.878104    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:36.598321 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:36.598286    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:37.315623 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:37.315583    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:38.004989 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:38.004947    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:38.698106 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:38.698071    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:39.672959 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:39.672908    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:40.480084 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:40.480046    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:41.190067 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:41.190027    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:41.994532 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:41.994491    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:42.800922 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:42.800885    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:43.537670 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:43.537626    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:44.302511 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:44.302466    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:44.505776 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:44.505738    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:44.999334 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:44.999301    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:45.522732 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:45.522691    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:45.721177 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:45.721143    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:46.386036 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:46.385999    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:46.593498 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:46.593456    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:47.155201 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:47.155162    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:47.870256 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:47.870212    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:48.589123 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:48.589082    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:49.288907 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:49.288868    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:49.707090 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:49.707012    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:49.961414 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:49.961296    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:50.178375 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:50.178326    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:52.659759 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:52.659723    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 21:23:52.667196 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:52.667164    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 21:23:53.929393 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:23:53.929328    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:23:55.765383 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:55.757974    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:55.960160 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:55.960116    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:56.506611 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:23:56.506561    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:02.518097 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:02.518058    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:02.738497 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:02.738453    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:02.760468 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:02.760429    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"]
Oct 30 21:24:02.760763 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:02.760735    4948 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9" podUID="0961cc62-f5c3-4405-a07c-58f48c84402a" containerName="istio-proxy" containerID="cri-o://82fd6b7940676387d8bc7ad2df0b1c1657656124a6fca834c0611b770fb322eb" gracePeriod=30
Oct 30 21:24:02.974315 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:02.974265    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:07.839028 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:07.838981    4948 patch_prober.go:29] interesting pod/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused" start-of-body=
Oct 30 21:24:07.839729 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:07.839687    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9" podUID="0961cc62-f5c3-4405-a07c-58f48c84402a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.109:15021/healthz/ready\": dial tcp 10.132.0.109:15021: connect: connection refused"
Oct 30 21:24:08.195512 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.195483    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:24:08.214969 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.214928    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-workload-socket\") pod \"0961cc62-f5c3-4405-a07c-58f48c84402a\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") "
Oct 30 21:24:08.215180 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.215047    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-data\") pod \"0961cc62-f5c3-4405-a07c-58f48c84402a\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") "
Oct 30 21:24:08.215180 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.215082    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0961cc62-f5c3-4405-a07c-58f48c84402a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0961cc62-f5c3-4405-a07c-58f48c84402a-istiod-ca-cert\") pod \"0961cc62-f5c3-4405-a07c-58f48c84402a\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") "
Oct 30 21:24:08.215180 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.215109    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-podinfo\") pod \"0961cc62-f5c3-4405-a07c-58f48c84402a\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") "
Oct 30 21:24:08.215180 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.215133    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-workload-certs\") pod \"0961cc62-f5c3-4405-a07c-58f48c84402a\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") "
Oct 30 21:24:08.215180 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.215170    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-token\" (UniqueName: \"kubernetes.io/projected/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-token\") pod \"0961cc62-f5c3-4405-a07c-58f48c84402a\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") "
Oct 30 21:24:08.215463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.215230    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0961cc62-f5c3-4405-a07c-58f48c84402a-kube-api-access-cm799\" (UniqueName: \"kubernetes.io/projected/0961cc62-f5c3-4405-a07c-58f48c84402a-kube-api-access-cm799\") pod \"0961cc62-f5c3-4405-a07c-58f48c84402a\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") "
Oct 30 21:24:08.215463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.215249    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-credential-socket\") pod \"0961cc62-f5c3-4405-a07c-58f48c84402a\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") "
Oct 30 21:24:08.215463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.215251    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-workload-socket" pod "0961cc62-f5c3-4405-a07c-58f48c84402a" (UID: "0961cc62-f5c3-4405-a07c-58f48c84402a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:24:08.215463 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.215382    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-data" pod "0961cc62-f5c3-4405-a07c-58f48c84402a" (UID: "0961cc62-f5c3-4405-a07c-58f48c84402a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:24:08.215680 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.215572    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-credential-socket" pod "0961cc62-f5c3-4405-a07c-58f48c84402a" (UID: "0961cc62-f5c3-4405-a07c-58f48c84402a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:24:08.215680 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.215587    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-workload-certs" pod "0961cc62-f5c3-4405-a07c-58f48c84402a" (UID: "0961cc62-f5c3-4405-a07c-58f48c84402a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:24:08.215680 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.215587    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0961cc62-f5c3-4405-a07c-58f48c84402a-istiod-ca-cert" pod "0961cc62-f5c3-4405-a07c-58f48c84402a" (UID: "0961cc62-f5c3-4405-a07c-58f48c84402a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:24:08.215680 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.215275    4948 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-envoy\") pod \"0961cc62-f5c3-4405-a07c-58f48c84402a\" (UID: \"0961cc62-f5c3-4405-a07c-58f48c84402a\") "
Oct 30 21:24:08.216018 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.215995    4948 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-workload-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:24:08.216018 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.216018    4948 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-data\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:24:08.216209 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.216033    4948 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0961cc62-f5c3-4405-a07c-58f48c84402a-istiod-ca-cert\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:24:08.216209 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.216046    4948 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-workload-certs\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:24:08.216209 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.216059    4948 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-credential-socket\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:24:08.217726 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.217702    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-envoy" pod "0961cc62-f5c3-4405-a07c-58f48c84402a" (UID: "0961cc62-f5c3-4405-a07c-58f48c84402a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:24:08.217825 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.217701    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-podinfo" pod "0961cc62-f5c3-4405-a07c-58f48c84402a" (UID: "0961cc62-f5c3-4405-a07c-58f48c84402a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:24:08.217986 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.217965    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-token" pod "0961cc62-f5c3-4405-a07c-58f48c84402a" (UID: "0961cc62-f5c3-4405-a07c-58f48c84402a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:24:08.218024 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.217997    4948 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0961cc62-f5c3-4405-a07c-58f48c84402a-kube-api-access-cm799" pod "0961cc62-f5c3-4405-a07c-58f48c84402a" (UID: "0961cc62-f5c3-4405-a07c-58f48c84402a"). InnerVolumeSpecName "kube-api-access-cm799". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:24:08.316940 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.316893    4948 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-token\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:24:08.316940 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.316934    4948 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm799\" (UniqueName: \"kubernetes.io/projected/0961cc62-f5c3-4405-a07c-58f48c84402a-kube-api-access-cm799\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:24:08.316940 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.316947    4948 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-envoy\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:24:08.317209 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.316958    4948 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0961cc62-f5c3-4405-a07c-58f48c84402a-istio-podinfo\") on node \"ip-10-0-142-183.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:24:08.512687 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.512614    4948 generic.go:356] "Generic (PLEG): container finished" podID="0961cc62-f5c3-4405-a07c-58f48c84402a" containerID="82fd6b7940676387d8bc7ad2df0b1c1657656124a6fca834c0611b770fb322eb" exitCode=0
Oct 30 21:24:08.512886 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.512697    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9" event={"ID":"0961cc62-f5c3-4405-a07c-58f48c84402a","Type":"ContainerDied","Data":"82fd6b7940676387d8bc7ad2df0b1c1657656124a6fca834c0611b770fb322eb"}
Oct 30 21:24:08.512886 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.512709    4948 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"
Oct 30 21:24:08.512886 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.512741    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9" event={"ID":"0961cc62-f5c3-4405-a07c-58f48c84402a","Type":"ContainerDied","Data":"2fe20872959cb97cc3086dfcec604a08bf9abe0175ec278641702cc4064f1854"}
Oct 30 21:24:08.512886 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.512763    4948 scope.go:122] "RemoveContainer" containerID="82fd6b7940676387d8bc7ad2df0b1c1657656124a6fca834c0611b770fb322eb"
Oct 30 21:24:08.522737 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.522714    4948 scope.go:122] "RemoveContainer" containerID="9ac839e2f844ac0d2f3574d8f78a5a348f2363d2ba145f9d6b77a989e65b9a1c"
Oct 30 21:24:08.536107 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.536026    4948 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"]
Oct 30 21:24:08.536192 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.536159    4948 scope.go:122] "RemoveContainer" containerID="82fd6b7940676387d8bc7ad2df0b1c1657656124a6fca834c0611b770fb322eb"
Oct 30 21:24:08.536618 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:24:08.536595    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82fd6b7940676387d8bc7ad2df0b1c1657656124a6fca834c0611b770fb322eb\": container with ID starting with 82fd6b7940676387d8bc7ad2df0b1c1657656124a6fca834c0611b770fb322eb not found: ID does not exist" containerID="82fd6b7940676387d8bc7ad2df0b1c1657656124a6fca834c0611b770fb322eb"
Oct 30 21:24:08.536774 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.536640    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82fd6b7940676387d8bc7ad2df0b1c1657656124a6fca834c0611b770fb322eb"} err="failed to get container status \"82fd6b7940676387d8bc7ad2df0b1c1657656124a6fca834c0611b770fb322eb\": rpc error: code = NotFound desc = could not find container \"82fd6b7940676387d8bc7ad2df0b1c1657656124a6fca834c0611b770fb322eb\": container with ID starting with 82fd6b7940676387d8bc7ad2df0b1c1657656124a6fca834c0611b770fb322eb not found: ID does not exist"
Oct 30 21:24:08.536774 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.536680    4948 scope.go:122] "RemoveContainer" containerID="9ac839e2f844ac0d2f3574d8f78a5a348f2363d2ba145f9d6b77a989e65b9a1c"
Oct 30 21:24:08.537030 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:24:08.537005    4948 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ac839e2f844ac0d2f3574d8f78a5a348f2363d2ba145f9d6b77a989e65b9a1c\": container with ID starting with 9ac839e2f844ac0d2f3574d8f78a5a348f2363d2ba145f9d6b77a989e65b9a1c not found: ID does not exist" containerID="9ac839e2f844ac0d2f3574d8f78a5a348f2363d2ba145f9d6b77a989e65b9a1c"
Oct 30 21:24:08.537082 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.537041    4948 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ac839e2f844ac0d2f3574d8f78a5a348f2363d2ba145f9d6b77a989e65b9a1c"} err="failed to get container status \"9ac839e2f844ac0d2f3574d8f78a5a348f2363d2ba145f9d6b77a989e65b9a1c\": rpc error: code = NotFound desc = could not find container \"9ac839e2f844ac0d2f3574d8f78a5a348f2363d2ba145f9d6b77a989e65b9a1c\": container with ID starting with 9ac839e2f844ac0d2f3574d8f78a5a348f2363d2ba145f9d6b77a989e65b9a1c not found: ID does not exist"
Oct 30 21:24:08.539805 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:08.539774    4948 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-authcfg-http-d8974d-openshift-default-555f5dc985-c46w9"]
Oct 30 21:24:10.293624 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:10.293580    4948 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0961cc62-f5c3-4405-a07c-58f48c84402a" path="/var/lib/kubelet/pods/0961cc62-f5c3-4405-a07c-58f48c84402a/volumes"
Oct 30 21:24:12.626551 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:12.626506    4948 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-s5sz7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:24:12.627216 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:12.627178    4948 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-s5sz7" podUID="50064880-6515-47ea-91f3-7e236b73eaf0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:24:23.929523 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:24:23.929483    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:24:45.694857 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:45.694764    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:46.610856 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:46.610814    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:49.948529 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:24:49.948490    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:54.050225 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:24:54.050002    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:25:04.550012 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:04.549953    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55d44b6fdc-wndvd_f023841c-b373-4ee6-be04-ba2e79ab6bf0/manager/0.log"
Oct 30 21:25:04.732976 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:04.732943    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-p6rxs_e87c7645-a0a3-4d64-b7d2-341ae1904c3f/server/0.log"
Oct 30 21:25:04.927749 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:04.927712    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-8jvn6_df574cad-90aa-412f-a80b-47ad82bae3d3/manager/0.log"
Oct 30 21:25:05.134237 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:05.134201    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-9v9tg_bd4288f8-819d-42eb-abc4-22e158b6deb6/proxy/0.log"
Oct 30 21:25:06.049886 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:06.049853    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5d4dc8d99b-llkzt_c5355136-bad5-4326-8993-dc5e89781e90/maas-api/0.log"
Oct 30 21:25:07.337344 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:07.337310    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-c8m2j_1a22a4ff-734b-412c-bbe2-57b87c6222f4/postgres/0.log"
Oct 30 21:25:11.157062 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:11.157016    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-p9tv7_f858690f-051c-4fa3-b4d7-bad7392d5650/discovery/0.log"
Oct 30 21:25:11.348281 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:11.348249    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85bbc4c96f-dkcgw_26cc8cba-9eff-426b-b98a-c88816f103c7/kube-auth-proxy/0.log"
Oct 30 21:25:11.711044 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:11.711009    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-2sd5b_d6d65231-7d0f-4f6a-ac10-e51e952ba70e/istio-proxy/0.log"
Oct 30 21:25:12.084585 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:12.084550    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-b5gx2_1a79c6f2-f405-4bf1-b639-8be072ae6a5a/istio-proxy/1.log"
Oct 30 21:25:12.822431 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:12.822399    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-hjllt_c43e679e-4441-4d13-b292-f52e9156418b/istio-proxy/0.log"
Oct 30 21:25:13.406094 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:13.406052    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-s5sz7_50064880-6515-47ea-91f3-7e236b73eaf0/istio-proxy/1.log"
Oct 30 21:25:13.758446 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:13.758336    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-sngkx_588d49fd-02d6-4223-84e1-3053a065054b/payload-pre-processing/0.log"
Oct 30 21:25:13.932824 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:13.932788    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-shr5q_16b64490-6c2c-433e-8289-02110c8c0d94/payload-processing/0.log"
Oct 30 21:25:14.122001 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:14.121955    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fc784755f-fpdq5_86ced41b-f67d-4a69-9c48-81be43c75698/router/0.log"
Oct 30 21:25:14.547062 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:14.546976    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-b5gx2_1a79c6f2-f405-4bf1-b639-8be072ae6a5a/istio-proxy/0.log"
Oct 30 21:25:15.653783 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:15.653746    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-s5sz7_50064880-6515-47ea-91f3-7e236b73eaf0/istio-proxy/0.log"
Oct 30 21:25:16.188057 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:16.188019    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28_7f4ad782-1866-4c55-b002-615ea7f0ae80/main/0.log"
Oct 30 21:25:16.734287 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:16.734251    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-9pr9k_4c7b1669-f714-4c25-bef4-1435e11b31fd/main/0.log"
Oct 30 21:25:17.105520 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:17.105489    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-t7btd_86a4c2e8-bcd1-4b05-89f8-a968f0d4addc/main/0.log"
Oct 30 21:25:17.290253 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:17.290204    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl_97ca19de-fe6b-41ee-9bc6-146e7df45955/main/0.log"
Oct 30 21:25:23.929423 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:25:23.929376    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:25:28.636436 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:28.636389    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55d44b6fdc-wndvd_f023841c-b373-4ee6-be04-ba2e79ab6bf0/manager/0.log"
Oct 30 21:25:28.849217 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:28.849186    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-p6rxs_e87c7645-a0a3-4d64-b7d2-341ae1904c3f/server/0.log"
Oct 30 21:25:29.035442 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:29.035308    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-8jvn6_df574cad-90aa-412f-a80b-47ad82bae3d3/manager/0.log"
Oct 30 21:25:29.247999 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:29.247961    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-9v9tg_bd4288f8-819d-42eb-abc4-22e158b6deb6/proxy/0.log"
Oct 30 21:25:29.971834 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:29.971803    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5d4dc8d99b-llkzt_c5355136-bad5-4326-8993-dc5e89781e90/maas-api/0.log"
Oct 30 21:25:31.046968 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:31.046899    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-c8m2j_1a22a4ff-734b-412c-bbe2-57b87c6222f4/postgres/0.log"
Oct 30 21:25:35.207516 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:35.207471    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-p9tv7_f858690f-051c-4fa3-b4d7-bad7392d5650/discovery/0.log"
Oct 30 21:25:35.400973 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:35.400944    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85bbc4c96f-dkcgw_26cc8cba-9eff-426b-b98a-c88816f103c7/kube-auth-proxy/0.log"
Oct 30 21:25:35.782014 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:35.781960    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-2sd5b_d6d65231-7d0f-4f6a-ac10-e51e952ba70e/istio-proxy/0.log"
Oct 30 21:25:36.168376 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:36.168336    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-b5gx2_1a79c6f2-f405-4bf1-b639-8be072ae6a5a/istio-proxy/1.log"
Oct 30 21:25:37.034224 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:37.034190    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-hjllt_c43e679e-4441-4d13-b292-f52e9156418b/istio-proxy/0.log"
Oct 30 21:25:37.582233 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:37.582196    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-s5sz7_50064880-6515-47ea-91f3-7e236b73eaf0/istio-proxy/1.log"
Oct 30 21:25:37.974475 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:37.974382    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-sngkx_588d49fd-02d6-4223-84e1-3053a065054b/payload-pre-processing/0.log"
Oct 30 21:25:38.155927 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:38.155891    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-shr5q_16b64490-6c2c-433e-8289-02110c8c0d94/payload-processing/0.log"
Oct 30 21:25:38.337800 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:38.337766    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fc784755f-fpdq5_86ced41b-f67d-4a69-9c48-81be43c75698/router/0.log"
Oct 30 21:25:38.854112 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:38.854073    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-wvx28_7f4ad782-1866-4c55-b002-615ea7f0ae80/main/0.log"
Oct 30 21:25:39.405917 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:39.405877    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-9pr9k_4c7b1669-f714-4c25-bef4-1435e11b31fd/main/0.log"
Oct 30 21:25:39.788147 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:39.788060    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-t7btd_86a4c2e8-bcd1-4b05-89f8-a968f0d4addc/main/0.log"
Oct 30 21:25:39.981093 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:39.981059    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-9hwwl_97ca19de-fe6b-41ee-9bc6-146e7df45955/main/0.log"
Oct 30 21:25:45.665355 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:45.665304    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:47.002255 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:47.002215    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:49.994657 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:25:49.994617    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:53.929902 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:25:53.929860    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:26:19.669110 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:26:19.669018    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55d44b6fdc-wndvd_f023841c-b373-4ee6-be04-ba2e79ab6bf0/manager/0.log"
Oct 30 21:26:19.957827 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:26:19.957719    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55d44b6fdc-wndvd_f023841c-b373-4ee6-be04-ba2e79ab6bf0/manager/0.log"
Oct 30 21:26:20.698919 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:26:20.698882    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-shr5q_16b64490-6c2c-433e-8289-02110c8c0d94/payload-processing/0.log"
Oct 30 21:26:20.883665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:26:20.883635    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-shr5q_16b64490-6c2c-433e-8289-02110c8c0d94/payload-processing/0.log"
Oct 30 21:26:23.929856 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:26:23.929814    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:26:45.715481 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:26:45.715435    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:46.720218 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:26:46.720175    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:50.050867 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:26:50.050828    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:53.928752 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:26:53.928712    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:27:06.223642 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:06.223595    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55d44b6fdc-wndvd_f023841c-b373-4ee6-be04-ba2e79ab6bf0/manager/0.log"
Oct 30 21:27:06.512322 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:06.512188    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55d44b6fdc-wndvd_f023841c-b373-4ee6-be04-ba2e79ab6bf0/manager/0.log"
Oct 30 21:27:07.180745 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:07.180707    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-shr5q_16b64490-6c2c-433e-8289-02110c8c0d94/payload-processing/0.log"
Oct 30 21:27:07.354714 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:07.354678    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-shr5q_16b64490-6c2c-433e-8289-02110c8c0d94/payload-processing/0.log"
Oct 30 21:27:07.916310 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:07.916266    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:08.136602 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:08.136565    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:11.248949 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:11.248910    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jk8sp_34e89d20-b285-4246-8184-9fe736a2c6fb/global-pull-secret-syncer/0.log"
Oct 30 21:27:11.405641 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:11.405609    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-5rf4c_990e57a8-4ba2-43be-8108-2bcf3b8da004/connection-checker/0.log"
Oct 30 21:27:11.433853 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:11.433821    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-cd525_f264b5d9-bc95-4e78-b399-43e8148c8768/connection-checker/0.log"
Oct 30 21:27:11.468408 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:11.468356    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-sbz2m_e9ba6324-4a54-40b9-8c8c-b2dee0510797/connection-checker/0.log"
Oct 30 21:27:11.546492 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:11.546388    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log"
Oct 30 21:27:11.720349 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:11.720310    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-183.us-east-2.compute.internal_289e7d851e39af0854a82e99a8d41138/haproxy/0.log"
Oct 30 21:27:20.295247 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.295194    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-5pmqz_86386c5c-e63e-4a97-a58e-ee79814a585f/cluster-monitoring-operator/0.log"
Oct 30 21:27:20.600024 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.599980    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t99w9_2436dc6f-03e6-48ed-8123-4372ef40b545/node-exporter/0.log"
Oct 30 21:27:20.636195 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.636164    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t99w9_2436dc6f-03e6-48ed-8123-4372ef40b545/kube-rbac-proxy/0.log"
Oct 30 21:27:20.665077 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.665049    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t99w9_2436dc6f-03e6-48ed-8123-4372ef40b545/init-textfile/0.log"
Oct 30 21:27:20.729053 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.729016    4948 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"]
Oct 30 21:27:20.729492 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.729478    4948 cpu_manager.go:414] "containerMap: removing container" podUID="0961cc62-f5c3-4405-a07c-58f48c84402a" containerName="istio-proxy"
Oct 30 21:27:20.729542 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.729494    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0961cc62-f5c3-4405-a07c-58f48c84402a" containerName="istio-proxy"
Oct 30 21:27:20.729542 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.729521    4948 cpu_manager.go:414] "containerMap: removing container" podUID="0961cc62-f5c3-4405-a07c-58f48c84402a" containerName="istio-proxy"
Oct 30 21:27:20.729542 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.729526    4948 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0961cc62-f5c3-4405-a07c-58f48c84402a" containerName="istio-proxy"
Oct 30 21:27:20.729648 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.729601    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="0961cc62-f5c3-4405-a07c-58f48c84402a" containerName="istio-proxy"
Oct 30 21:27:20.729648 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.729615    4948 memory_manager.go:365] "RemoveStaleState removing state" podUID="0961cc62-f5c3-4405-a07c-58f48c84402a" containerName="istio-proxy"
Oct 30 21:27:20.732899 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.732873    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:20.743101 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.743069    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"]
Oct 30 21:27:20.774180 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.774130    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wp95\" (UniqueName: \"kubernetes.io/projected/5afdd97b-2486-49c2-bbb4-12834f6c294c-kube-api-access-8wp95\") pod \"perf-node-gather-daemonset-t4lhh\" (UID: \"5afdd97b-2486-49c2-bbb4-12834f6c294c\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:20.774180 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.774186    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5afdd97b-2486-49c2-bbb4-12834f6c294c-sys\") pod \"perf-node-gather-daemonset-t4lhh\" (UID: \"5afdd97b-2486-49c2-bbb4-12834f6c294c\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:20.774513 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.774273    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5afdd97b-2486-49c2-bbb4-12834f6c294c-lib-modules\") pod \"perf-node-gather-daemonset-t4lhh\" (UID: \"5afdd97b-2486-49c2-bbb4-12834f6c294c\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:20.774513 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.774433    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5afdd97b-2486-49c2-bbb4-12834f6c294c-proc\") pod \"perf-node-gather-daemonset-t4lhh\" (UID: \"5afdd97b-2486-49c2-bbb4-12834f6c294c\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:20.774513 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.774484    4948 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5afdd97b-2486-49c2-bbb4-12834f6c294c-podres\") pod \"perf-node-gather-daemonset-t4lhh\" (UID: \"5afdd97b-2486-49c2-bbb4-12834f6c294c\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:20.836022 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.835983    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dwnkd\"/\"openshift-service-ca.crt\""
Oct 30 21:27:20.836281 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.836110    4948 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dwnkd\"/\"kube-root-ca.crt\""
Oct 30 21:27:20.840704 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.840663    4948 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dwnkd\"/\"default-dockercfg-h2dpm\""
Oct 30 21:27:20.875456 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.875312    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5afdd97b-2486-49c2-bbb4-12834f6c294c-podres\") pod \"perf-node-gather-daemonset-t4lhh\" (UID: \"5afdd97b-2486-49c2-bbb4-12834f6c294c\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:20.875456 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.875438    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wp95\" (UniqueName: \"kubernetes.io/projected/5afdd97b-2486-49c2-bbb4-12834f6c294c-kube-api-access-8wp95\") pod \"perf-node-gather-daemonset-t4lhh\" (UID: \"5afdd97b-2486-49c2-bbb4-12834f6c294c\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:20.875665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.875465    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5afdd97b-2486-49c2-bbb4-12834f6c294c-sys\") pod \"perf-node-gather-daemonset-t4lhh\" (UID: \"5afdd97b-2486-49c2-bbb4-12834f6c294c\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:20.875665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.875471    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5afdd97b-2486-49c2-bbb4-12834f6c294c-podres\") pod \"perf-node-gather-daemonset-t4lhh\" (UID: \"5afdd97b-2486-49c2-bbb4-12834f6c294c\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:20.875665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.875486    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5afdd97b-2486-49c2-bbb4-12834f6c294c-lib-modules\") pod \"perf-node-gather-daemonset-t4lhh\" (UID: \"5afdd97b-2486-49c2-bbb4-12834f6c294c\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:20.875665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.875552    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5afdd97b-2486-49c2-bbb4-12834f6c294c-sys\") pod \"perf-node-gather-daemonset-t4lhh\" (UID: \"5afdd97b-2486-49c2-bbb4-12834f6c294c\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:20.875665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.875565    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5afdd97b-2486-49c2-bbb4-12834f6c294c-lib-modules\") pod \"perf-node-gather-daemonset-t4lhh\" (UID: \"5afdd97b-2486-49c2-bbb4-12834f6c294c\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:20.875665 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.875619    4948 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5afdd97b-2486-49c2-bbb4-12834f6c294c-proc\") pod \"perf-node-gather-daemonset-t4lhh\" (UID: \"5afdd97b-2486-49c2-bbb4-12834f6c294c\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:20.875944 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.875697    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5afdd97b-2486-49c2-bbb4-12834f6c294c-proc\") pod \"perf-node-gather-daemonset-t4lhh\" (UID: \"5afdd97b-2486-49c2-bbb4-12834f6c294c\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:20.888139 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:20.888104    4948 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wp95\" (UniqueName: \"kubernetes.io/projected/5afdd97b-2486-49c2-bbb4-12834f6c294c-kube-api-access-8wp95\") pod \"perf-node-gather-daemonset-t4lhh\" (UID: \"5afdd97b-2486-49c2-bbb4-12834f6c294c\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:21.046221 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:21.046177    4948 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:21.329228 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:21.329193    4948 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"]
Oct 30 21:27:21.331777 ip-10-0-142-183 kubenswrapper[4948]: W1030 21:27:21.331746    4948 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5afdd97b_2486_49c2_bbb4_12834f6c294c.slice/crio-883a729d35da98b441ec9af6b57483dceb0c211b24a2927ac57d926c9e40ab14 WatchSource:0}: Error finding container 883a729d35da98b441ec9af6b57483dceb0c211b24a2927ac57d926c9e40ab14: Status 404 returned error can't find the container with id 883a729d35da98b441ec9af6b57483dceb0c211b24a2927ac57d926c9e40ab14
Oct 30 21:27:21.591625 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:21.591585    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh" event={"ID":"5afdd97b-2486-49c2-bbb4-12834f6c294c","Type":"ContainerStarted","Data":"79e43075d49881366a144d7d31f8776a86a6d6c9a3632334877b3b96151ecd98"}
Oct 30 21:27:21.591835 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:21.591651    4948 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh" event={"ID":"5afdd97b-2486-49c2-bbb4-12834f6c294c","Type":"ContainerStarted","Data":"883a729d35da98b441ec9af6b57483dceb0c211b24a2927ac57d926c9e40ab14"}
Oct 30 21:27:21.591835 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:21.591776    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:21.619439 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:21.619377    4948 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh" podStartSLOduration=1.619347258 podStartE2EDuration="1.619347258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:27:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:21.617830888 +0000 UTC m=+2909.437342876" watchObservedRunningTime="2026-10-30 21:27:21.619347258 +0000 UTC m=+2909.438859305"
Oct 30 21:27:22.724930 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:22.724892    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-fx72n_2c88c202-657d-49fd-83af-da47476931a9/networking-console-plugin/0.log"
Oct 30 21:27:23.373890 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:23.373861    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/3.log"
Oct 30 21:27:23.380724 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:23.380667    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-pjhmq_9d262282-6f9c-4945-959d-81e9a9a12392/console-operator/4.log"
Oct 30 21:27:23.889260 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:23.889222    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:23.929540 ip-10-0-142-183 kubenswrapper[4948]: E1030 21:27:23.929496    4948 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-kjcfz" containerName="extractor"
Oct 30 21:27:24.119333 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:24.119287    4948 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wl8g_c9a4a383-c9b9-4475-b22e-d336d1a35422/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:24.544274 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:24.544233    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-qthmt_7e9d8fb4-c43e-4973-b67b-7cca18f00408/volume-data-source-validator/0.log"
Oct 30 21:27:25.829659 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:25.829629    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xchc6_d204b46f-c6a4-440f-8078-ce647d423f59/dns/0.log"
Oct 30 21:27:25.854240 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:25.854207    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xchc6_d204b46f-c6a4-440f-8078-ce647d423f59/kube-rbac-proxy/0.log"
Oct 30 21:27:25.909947 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:25.909915    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8g6wj_571e6927-684b-4d97-b9ab-4d2581d5235a/dns-node-resolver/0.log"
Oct 30 21:27:26.665921 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:26.665887    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-778mq_f0f30507-57cb-4145-bd0c-f44b3698d7ab/node-ca/0.log"
Oct 30 21:27:27.607062 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:27.607035    4948 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-t4lhh"
Oct 30 21:27:30.191826 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:30.191786    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-p9tv7_f858690f-051c-4fa3-b4d7-bad7392d5650/discovery/0.log"
Oct 30 21:27:30.222204 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:30.222172    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85bbc4c96f-dkcgw_26cc8cba-9eff-426b-b98a-c88816f103c7/kube-auth-proxy/0.log"
Oct 30 21:27:30.311816 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:30.311779    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-2sd5b_d6d65231-7d0f-4f6a-ac10-e51e952ba70e/istio-proxy/0.log"
Oct 30 21:27:30.398831 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:30.398798    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-b5gx2_1a79c6f2-f405-4bf1-b639-8be072ae6a5a/istio-proxy/1.log"
Oct 30 21:27:30.399141 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:30.399118    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-b5gx2_1a79c6f2-f405-4bf1-b639-8be072ae6a5a/istio-proxy/0.log"
Oct 30 21:27:30.556565 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:30.556472    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-hjllt_c43e679e-4441-4d13-b292-f52e9156418b/istio-proxy/0.log"
Oct 30 21:27:30.666709 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:30.666664    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-s5sz7_50064880-6515-47ea-91f3-7e236b73eaf0/istio-proxy/1.log"
Oct 30 21:27:30.667345 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:30.667323    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-s5sz7_50064880-6515-47ea-91f3-7e236b73eaf0/istio-proxy/0.log"
Oct 30 21:27:30.739122 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:30.739093    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-sngkx_588d49fd-02d6-4223-84e1-3053a065054b/payload-pre-processing/0.log"
Oct 30 21:27:30.768656 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:30.768625    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-shr5q_16b64490-6c2c-433e-8289-02110c8c0d94/payload-processing/0.log"
Oct 30 21:27:30.807499 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:30.807406    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fc784755f-fpdq5_86ced41b-f67d-4a69-9c48-81be43c75698/router/0.log"
Oct 30 21:27:32.196416 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:32.196373    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gxp9z_2d040316-e799-40d0-b5ee-2a4351ca99bd/serve-healthcheck-canary/0.log"
Oct 30 21:27:32.885198 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:32.885145    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-sxgrn_21b1d440-8b5c-4e0b-b3bf-e74befdce48e/insights-operator/0.log"
Oct 30 21:27:32.888051 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:32.888016    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-sxgrn_21b1d440-8b5c-4e0b-b3bf-e74befdce48e/insights-operator/1.log"
Oct 30 21:27:33.008969 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:33.008929    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kjcfz_93430674-7eab-453f-a278-c8d352572441/kube-rbac-proxy/0.log"
Oct 30 21:27:33.040279 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:33.040238    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kjcfz_93430674-7eab-453f-a278-c8d352572441/exporter/0.log"
Oct 30 21:27:33.073728 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:33.073692    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kjcfz_93430674-7eab-453f-a278-c8d352572441/extractor/0.log"
Oct 30 21:27:33.530645 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:33.530612    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-p9tv7_f858690f-051c-4fa3-b4d7-bad7392d5650/discovery/0.log"
Oct 30 21:27:33.547074 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:33.547046    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85bbc4c96f-dkcgw_26cc8cba-9eff-426b-b98a-c88816f103c7/kube-auth-proxy/0.log"
Oct 30 21:27:33.591000 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:33.590957    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-2sd5b_d6d65231-7d0f-4f6a-ac10-e51e952ba70e/istio-proxy/0.log"
Oct 30 21:27:33.629891 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:33.629807    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-b5gx2_1a79c6f2-f405-4bf1-b639-8be072ae6a5a/istio-proxy/1.log"
Oct 30 21:27:33.630150 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:33.630119    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-b5gx2_1a79c6f2-f405-4bf1-b639-8be072ae6a5a/istio-proxy/0.log"
Oct 30 21:27:33.699834 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:33.699802    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-hjllt_c43e679e-4441-4d13-b292-f52e9156418b/istio-proxy/0.log"
Oct 30 21:27:33.752944 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:33.752912    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-s5sz7_50064880-6515-47ea-91f3-7e236b73eaf0/istio-proxy/1.log"
Oct 30 21:27:33.753226 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:33.753211    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-s5sz7_50064880-6515-47ea-91f3-7e236b73eaf0/istio-proxy/0.log"
Oct 30 21:27:33.785141 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:33.785057    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-sngkx_588d49fd-02d6-4223-84e1-3053a065054b/payload-pre-processing/0.log"
Oct 30 21:27:33.806162 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:33.806123    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-shr5q_16b64490-6c2c-433e-8289-02110c8c0d94/payload-processing/0.log"
Oct 30 21:27:33.827803 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:33.827770    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fc784755f-fpdq5_86ced41b-f67d-4a69-9c48-81be43c75698/router/0.log"
Oct 30 21:27:35.791723 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:35.791688    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5d46577d6f-8nd7j_b441dedd-43a1-42c2-8750-55fafae3e3d8/manager/0.log"
Oct 30 21:27:35.819774 ip-10-0-142-183 kubenswrapper[4948]: I1030 21:27:35.819708    4948 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5d46577d6f-8nd7j_b441dedd-43a1-42c2-8750-55fafae3e3d8/copy-manifests/0.log"